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PREFACE TO VOLUME l| 



The National Day Care Study (NDCS) is being 
conducted over a three^year period by the Day 
Care Services Division of the Office of Child 
Development (OCD! of the Office of Human 
Development, U.S. Department of Health, Edu^ 
cation and Welfare (HEW). This first annual 
report is designed to acquaint the reader with 
the work of the^NDCS from July 1974 to 
September 1975, It is assumed that the read^ 
er of Volume II is familiar with 'the background 
material presented in, Volume I. An overview 
of the study taken from that volume is pre^ 
serted below. 

Over the past seven years the federal govern- 
ment has become the major institutional con^ 
sumer of day care for children from six months 
to 14 years of age. During the 1975 fiscal 
^year alone, close to one^half billion dollars 
were spent to purchase welfare-related day 
care for some 550,000 children from both 
centers and family day homes {35 to 40 per 
oent of available licensed capacity). In the six 
fiscal years 1970-75, federal, state and local - 
government agencies have spent an estimated 
total of $2.4 billion on the direct purchase of 
day care services. About $1.8 billion of this 
wa:3 dispensed by the United States Depart^ 
ment of Health, Education^and Welfare (HEW),, 
as authorized by Title IV-A of the 1968 amsnd= 
ment to the Social Security Act (SSA)* which 
provides social service Aid to Families with 
Dependent Children (AFDC). The 50 states 
spent an additional $600 million to meet the 
25 percent matching requirement, and were 
responsible for adnninistering all funds. 

As a result of its role in day care, the fedaral 
government is concerned with the costs and 
effects on children of day care purchased as 
a service to welfare'eligible parents. This poli^ 
cy concern has been translated into a set of 
. regulations which apply to those day care 
■programs = homes and centers — serving one 



or more federally'Subsidized children. Since 
1968, the Federal Interagency Day Care Re^ 
quirements (FIDCR) have set standards regu^ 
lating a wide variety of program characterise ■ 
tics presumed to control the quality of class- 
room process and thereby both protect 
children from harm and positively affect 
thei'^ growth and development. For example, 
thr FIDCR specify the minimum number of 
caregivers that are to be available to each \ 
group of children, according to the age of the 
children. The FIDCR also mandate that at 
least one caregiver in each group be trained 
or have demonstrated abilityjn working with 
children. These staffing requirements clearly 
attempt to determine the quality of the day- 
to-day classroqm'^experience. Equaily, these 
requirements have important cost implica^ 
tions. 

The 1968 FIDCR, developed jointly by HEW, 
the D,epartment of Labor (DOL) and the 
Office of Economic Opportunity (OEO), were 
based on expert judgment and the best avaih 
able evidence. However, no carefully-designed, 
large^scale studies of day care were available to 
pplicy-makers at the time the FIDCR were 
developed. There were no data illuminating 
the relationships among day care classroom 
processes, child outcomes, program costs and 
the key FIDCR;regulated program character^ 
istics: staff/child ratio, staff professionalism 
and grouf^' size. 

The National Day Care Study will assess the 
costs and the effects of both current and nlter^ 
native federal day care policies. The NDCS 
focuses on the costs and effects on federally^ 
subsidiz&d preschoolers of larger full-day, 
full-year urban day care center programs. 
More specifically, the NDCS is being designed 
to answer the following major policy questions: 

® How is the d^.velopment of preschool 
children in federally-subsidized day care 

^ centers affected by variations in staff/ 
child ratio, staff professionalism, group 
size and/or other regulatable center char 
acteristics? 



^Title jV=A was replaced by the Title XX amendment 
to the SSAJn early 1975, 



• How is the per child cost of center day 
care affected by variations in staff/child 



ratio, staff professionalism, group size 
and/or other regulatable center character= 
istics? 

© How does the cost-effectiveness of feder= 
ally-subsidized center-based day care 
change when adjustments are made in 
staff/child ratio, staff professionalism, 
group size and/or other regulatable cen- 
ter chaf^acteristics? 

In December of. 1977, the NDCS will complete 
work on the three ma/or policy questions. At 
that tinm, it will present systematic findings 
to the government on the cost'effectiveness 
of the current FIDCR and the potential effects 
of alternative regulations on children, on costs 
and on the supply of center day care. Study 
findings will be contained Jn a series of public 
reports developed during 1976 and 
This report is the first public documentation 
of the study's background and design. 

The First Annual Report is published in three 
volumes. Volume I, available for general dis- ^ 
tribution, presents an overview of the NDCS: 
the background of federal involvement in day 
care, the day care policy issues being address^ 
ed, an overview of the study design and phases, 
the uses and limits of the study findings and 
the results of Phase I, 

Volume II, which is available upon request, 
presents the research design for Phase 1 1 and 
includes a detailed technical discussion of the 
study's analytical and methodological ssues. 

Volume III is a compendium of the program, 
costs, and parent mepsurement instruments 
and systems designed for use during Phase H 
by Abt Associates Inc. (AAI), the research 
contractor. The battery of instruments select- 
ed to measure classroonn processes and child 
outcomes during Phase II is uescribed by 
Stanford Research Institute (SRI), the testing 
contractor, in a separate report. 

Volume II is organized into six chapters as 
follows: 

Chapter 1: PHASE II OBJECTIVECi presents 
the specific research goals of Phase II as an 
introduction to the technical materials which 



follow. Related to the fundamental policy 
questions discussed in Volume I, these research 
goals are presented both in general and in de- 
tailed fo^m, Each detailed research question 
is related to specific Phase II research products. 

Chapter 2: RESEARCH DESIGN outlines the 
Phase II design and describes the conceptual 
model of day care on which it is based. The 
chapter also presents a schedule of tlie princi^ 
pal data collection events and a simplified 
schedule of research tasks. 

Chapters: DISCUSSION OF VARIABLES 

specifies the content and construction of tlie 
major independent variables that characterize 
the structure and dynamics of the conceptual 
model. During Phase II they will be quanti- 
fied from program, observation, test and cost 
data so that hypotheses generated from the 
conceptual model can be tested. 

Chapter 4: RESEARCH AND ANALYSIS 
METHODOLOGY, with Chapter 5, presents 
the details of Phase II analytic methodology 
and is divided into twoparts: 1 ) the prelim- 
inary development of a quantified model of 
center day care that relates outcomes to 
their principal determinants, particularly to 
the three policy variables — staff/child ratio, 
professionalism, an^group size; and 2) de- 
velopment of an econom^ic model that re-/ 
lates day care cost to its principal determin- 
ants; particularly the three policy.4{ariables 
cited above. 

Chapters: TESTING AND VALIDATION 
OF CONCLUSIONS describes the process of 
testing and establishing the validity (external 
and internal) of preliminary quantitative re- 
sults, ana includes discussions of analytic biases, 
attrition effects, and adaptation, 

CHAPTERS: DEVELOPMENT OF PHASE III 
PLAN discusses how the results of Phase 1 1 
analysis will be used to develop a rese^arch de- 
sign for Phase III, including choices of centers,* 
sites, experimental manipulations of basTeJpro- 
gram variables, and choice of dependent mea= 
sures. 



IV 
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Cha pter 1; PHASE 11 OBJECTIVES 

This chapter presents a set of research questions 
and related research obiectives based on the 
three fundamental policy questions set forth 
in the Preface,* The research questions trans^ 
late the NDCS policy conserns into a quanti = 
tatively testable format. In later chapters these 
research questions will be used to discuss test 
able hypotheses about the dynamics of center^ 
based care and the relationship of center day 
care processes to day care outcomes, A major 
product of PhaseJI research will be an empiric^ 
ally^generated.S6t of hypotheses to be tested 
by statistical fnference in Phase ML In addition, 
the data collected during Phase II to answer re^ 
search question 1 below will be incorporated 
into an early series of policy monographs (see 
Volume I, Chapter 3) designed to address the 
issue of FIDCR appropriateness. 

Stated in general terms, ithe central questions 
for Phase 1 1 research are the following: 

^ . What are the regulatable (and non=regu = 
latable) center characteristics (indepen- 
dent variables), including staff/child 
ratio, professionalism^, and group size, 
which influence the development of pre^ 
school children, satisfaction of parents, 
and the cost of day care? 

2. Which eKogenous (background) variables, 
including family background and child 
characteristics, mediate the influence of 

day care, ant. must therefore be measured^ 

■\ - - - - 

3, How is the d&y care classroom process, 
including the structure and content of 
interactians among children and care- 
givers, influenced by center characteris- 
tics and exogenous variables? How does 
the content of classroom process in turn 
influence child development and satisfaC' 
tion of parents? 



*A detailed discussion of these three policy questions 
will be found in Chapter 2 of Volume I, 

/■ 

\ / 
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The first of these questions concerns the effect 
on day care outcomes of the day care center, 
its program, and its staff. The second question 
addresses the role of exogenous variables; ah 
though these variables are not of fundamental 
policy importance, they may so influence re- 
sults that their omission would distort policy-^ 
relevant effects. The third question focuses on 
classroom process. In addition to illuminating 
the mechanism by which center characteristics 
are linked to child outcomes, classroom pro= 
cess is important as an mtermediate, highly ■ 
visible outcome measure, 

Each of these research questions is further re= 
fined below in order to provide greater insight 
into the goals of Phase IL Question 1 consists 
of a complex set of definition and measure^ 
ment issues. Jt can be expanded to three separ^ 
ate sets of research questions. 

t,1 What are the important center character- 
istics which influence child and parent 
outcomes and center costs, and how 
should these variables be defined and 
^ measured? What is tlie composition in 
the natural day care center.world of 
such complex variables as staff /^hild 
ratio, professionalism, and group size? 
How do these variables differ across 
centers and over time? Hqw do real 
world variations in center characteris- 
tics affect research definitions? Which 
characteristics, other than those cur- 
rently subject to regulation, may be of 
importance: director qualifications? 
center auspices? group composition? 
physical plant structure? 

1 .2 What is the cost of center day care and 
how is it related to variations in impor- 
tant center characteristics as defined 
for analysis? 

1.3 How should child development and 
parent satisfaction be defined and 
measured? How should quality be de^ 
fined: as outcomes of service to child' 
ren? to parents? Should outcome be 
measured in terms of damage as well 

n 



as of development, and what are the 
significant components of these out- 
comes? What outcome measures are 
important to consumers of day care, 
to advocates^^and to the research com= 
munitfT"^ = = 

The next group of questions concerns possible 
effects of variables external to the center pro^ 
gram and structure. These ''background*' vari^ 
ables may influence outcome as much as or 
more than the policy-relevant center variables, 
or may mediate the influences of the policy 
variables. Research question 2 can be expand- 
ed as follows: 

2.1 Which family background variables are 
important influences on child develop^ 
ment and parent satisfaction? Do 
socioeconomic characteristics, parental 
attitudes, and chijdrearing practices 
influence outcome? Hp^ should these 
vari^btes be measured and operation- 
.ally defined? 

2:2 Boes"^ child's previous day care ex per i= 

ence influence child outcomes? 

2,3 Do contextual factors such as city cliar^ 
acteristics influence outcome? Are 
there d^ffe^ences'by site? Must the in^ 
fluence of different factors be consider- 
ed separately from site to site? 

Question 3 considers classroom processes as 
an intermediary group of variables which link 
center characteristics to child outcomes. In 
more detailed form, this question is as follows: 

3.1 Which day care cla^room processes 
are most meaningful as measures? How 
should these process variables be oper- 
ationally defined? 

3.2 Which center characteristics influence 
classroom process? Do particular qom- 
binations of center and program char^ 
acteristics influence classroom process 
in special ways? 

3.3 Which family backgrouiiu variables in= 
fluence process? 



3.4 What is the influence of a chiWs pre- 
vious day care experience on process 
variables? 

3.5 What is the influence of contextual 
factors, such as city characteristics, 
on process Y—-"^''" 

\ 

3.6 Which process varjables are most likely 
to influence child outcomes? How 
does an understanding of these influ- 
ences and of the influence of center 
characteristics on process (question 
3.2) clarify 'the influence of. cerrter 
characteristics on child outcomes? 

Questions 3,1 through 3,6 indicate that class= 
room process variables are being treated as 
intermediate between independent center - ^ 
variables and measures of outcome. They are 
considered because child and parent outcomes, 
Siich as improvements in child test scores or 
parent satisfaction, .may be effects of class- 
room processes rather than of center character- 
istics directly. Such explicit consideration'of 
classroom process as an intermediate "domain'' 
between center characteristips andthild and 
parent outcomes will strengthen the concep- 
tual connection between input and outcome 
domains. External evidence of the connection 
between process and child development may 
then be used to strengthen study results. 

Each of the three groups of research questions 
will be answered definitively at the end of 
Phase III: preliminary results obtained in 
Phase II will serve to develop testable hypo- 
theses and will be used in constructing the 
research design for Phase M I. The planning 
,of Phase III will, of necessity^ rely principally 
on observed variations in dassroom^ process 
rather than on children's developmental gains 
measured through pre-poat testing, 'For the 
purpbse of Phase III design, process variables 
will be adequate surrogates for test^based 
measures. Because developmental effects 
are the direct result of process variations 
rather than program variations per s&, vari- 
ation^ in child development attributable to 
the influence of center characteristics must 

■ \ 
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tepreceded. by vanations in classroom pro- ' 
„cess. Phase III centers will be selected to 
contain a representativs cross section dL, I 

classronm process. ■>- 

Each of the research questions will be address- 
ed during Phase II and will lead to a specific 
research product. Table M indicates the ob- 



jective for each question and its projected 
influence on the design of Phase III and/or 
selection of Phase III measures, As indicated. 
, answers to research questions 1.1 and 1.2 will 
be used in the development of four Phase II 
policy monographs (discussed in Chapter 3 
of Volume I). 



;-Tabie M 

Phase II Research Quastions/and Uses of Find 



ings 



PHASE Ii'reSEARCH QUESTIONS 



1 . Center Characteristice 

1.1 ^ Appropriate definition and measure 
of important center characteristics? 
1.2, Cost of day care? 

. 1^3 Appropriate definitioft and measure 
of child and parent outcomes? 

2. Background Variables 

2.1 Apprdpriate definition and measure 
of irriportant family variables? . 

2.2 Influence of child^s previous day 
care experience? 

2.3 Influences of site factors? 

3. Classroom Process 

3.1 Appropriate definitioh and measures 
of impof lant classroom processes? 

3.2 Influer^e of center characteristics 
on process? 

3.3 Infludnce of family variables on 
process? 

34 Influenr gf child^s previous day , 
care on .cess? 

3.5 Influence.- of site factors on process? 

3.6 Potential influences of proce-s on 
child o^utoomes? , / 
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An NDCS model of center day care will serve 
as a common point of .^^ference for issues to 
be considered in all.three phases of the Gtirdy, 
Presented in simplest form in Figure M (it 
will be expanded in the ne^t chapter), the 
model reflects our assumption that a group 
of independunt variables describing the site, 
center, child, and fLmily affects the center 
and classroom processes, .and that those pro^ 



cesses in, turn impact on children in day care. 
In addition, characteristics of the child and 
family directly affect outcome.without the 
intermediary described by center process 
variablco^ Finally, center characteristics dir- 
ectly influence center costs,^ All of the basic 
study hypotheses will be developed in terms 
of this simple modeh 



Figure 1-1 
Simplified NDCS Model of Day Care 
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Chapter 2: RESEARCH DESIGN OVER^ 
VIEW 



Figure 2-1 is a more detailed^verslon of the 
model of center day care ihown in Chapter 1* 
The figure lists mnemonic abbreviations for 
data collection instruments to be used during 
Phase II, Indicating the relation of each to 
variable groups of the model Descriptions of 
the different Phase 1 1 instruments are proi 
-vided in Table 2^1 on page 6.* 

Only conripontnts relevant to the NDCS are 
included in this model; that Is, the NDCS is 
focused on full-time care for three-and four- 
year-olds in study-eligible day care centers. 
Outcome domains are restricted to those 
identified in the chart and explained in detail 
later in this report. Moreover, this research 
concentrates on the influence of center day 
care on children and their parents and on the 
costs of cehter-based care. 

^e variables set forth in the model are dis- 
cussed in Chapter 3. The following paragraphs 
provide a brief orientation to the yariable 
groups. ^ " 

Independent varlabtes in this study encom- 
pass the policy variables of main interest: 
staff/child ratio, classroom staff profession- 
alism, and group size. Other center character- 
istics to be studied include auspices, funding, 
size, director professionalism, services, curric- 
ula' and similar descriptors, A set of exogenous 
independent variables must also be considered, 
/Site and community characteristics may also 
affect day care process. These include the 
socioeconomic characteristics of the site and 
specific structural properties of day care gov- 
ernance and funding at the site leveL Out- . 
comes are likely to be Influenced by the char- 
acteristics of the child and his/her family, such 
as educational attainment, family income, and 
family structure; by attitudes and eKpectations . 
of the family; and particularly by the child's 
previous eKperience in day care settings, other 

*SfH? Vqliimff I, AppendiK B: Datn Colfoctiun Systoms, 
for n full (loscrlptjon. 



early childhood programs, and any other ex^ 
perience likely to influence development. 
These variables may affect outcomes both 
directly ano indirectly, by mediation of the 
day care program. 

I 

Process variables include both the structural 
(quantitative) features of classroom interac- 
tions, such as the duration and frequency 
of staff-child contacts, ari^ the psychoeduca- 
tional (qualitative) contOTit of these interactions 
The overall process involves children, parents, 
and caregivers all togrther, but: it may be vievv- 
ed separately as chila-focused, parent-focused, 
or caregiver-focused. 

Outcome varfab/e$ represent the impact of day 
care on children and parents. Final outcome 
will be measured as positive and negative 
changes in the child, in terms of social/emo- 
tional, cognitive ability and cognitive style de- 
velopment, and in terms of the satisfaction of 
parents. 

As the research is carried out in ^hase II and 
Phase III, the relationships indicated by the 
model will be quantitatively inv^tigated.* 
Phase II results will be incomplete and tenta- 
tive compared to those provided jat the end 
of Phase III, since Phase II is a 'Matu/ar' study 
without experimental manipulation or control. 
Observations and analysis of the carefully 
selected set of study centers will jead to the 
formation of a controlled experirhent of con- 
siderable statistical power for Phase ML 

:The conceptual model wlll be coriverted to a 
statistically-analyzable form during Phase IL 
Realistic operatlbnal definitions fbr variables 
will be developed and statistical relations 
among variables Investigated. The basic math^ \\ 
ematical form is to^be a regression model, al- 
though other forms of tho general linear model ' 
will also be considered. This prQcnss of quan- 
tification and hvpothesis development is dis^ 
cussed in Chapter 4. 



For u moru cjotailptl OKplanatlan of tho ahjuciivus 
and soquoncjrin of , tho tliroo phasus af tho btudy, uj. 
for to Volumu 1, Cliuinor 3. 



FiguriM 
NDCS Mode! of Day Care 
with abbreviations of Data Col lection Instrumints 
(tf, Table 2-1) 
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Table 2-1 
Data Collsctioni 
Simplified Time Schedule and instruments 

/ 

October, ]975 - June, 1976 
RPIS 



RCAS 



Research Program Information System. Baieline data 
including center characteristics, policy variables. 

Research Cost Accounting System. All center income 
and'Bxpendlturesr — - — _ . „_ 



October - November, 1975 
PMI 



C01 



Parent Measures pre-interview, including child, family 
characteristics, .Vmily expectation, values, previous 
experience of child in day care and other programs. 

First Child Observations, using revised. Prescott instru^ 
ment. ^ 



CT1. Pre-test SRI test battery. 
January, 1976 

CPO ClaKroom Process Obiervation. Caregiver-focused 
beriavior, using SRI observation instrument. 

April May, 1^76 

PM2 Parent Measures post-ihtervlew, yielding satisfaction. 



C02 
CT2 



eni 

involyement data 
Second Child Observations. 
Post^test, SRI test battery. 
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TIMING OF PHASE II DATA COLLiCTION 
Three time points in Phase II are central to the 
analysis plan. Given the symbols T1, T1,5 and 
T2, they represent the times in fall 1975, win- 
ter 1976 and spring 1976 when major blocks 
of data are coll§c\ed and available. The times 
T1 and T2 represent pre* and post-periods for 
child testing^ child qbiervatlon, and parent 
measures. Time poi^t T1,S is the period In 
which classroom procfe$s data will be collected. 
This ichedule reflects the analytic distinction 
betweun measures wh = h primarily focus on 



developmental gains between T1 and T2 and 
those which concentrate on classroom process 
as the developmental environment Table 2^1 
provider a simplified outline of this time 
schedule, including ongoing nollections of pro^ 
gram and cost data. 

THi PHASE 11 RiSiARCH PLAN IN OUTLINE 

The NDCS research calendar is best presented 
in terms of those three data collectfon points,' 
Phase 1 1 1 specifications of sites, centers, and 
experimental manipulations are scheduled to 
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be made after T1 ,5 and are to be based on 
analysis of all data collected to that point. 
The final specif icatlon of Phase III meaiures 
will follow analysis of T2 data. This section 
presents the basic outline of the plan^ indicat- 
ing ly/raf is to be accompllihed rather than 
how it is to be accomplished. Methodology 
is discussed in Chapter 4. 

An ovemew of -research organization is pre- 
sented in Figure 2-2, followed by a discussion 
of the plan's components. The three groups 
of Phase 11 research and analysis tasks are as 
"^follows: ^ ' 

A, De vslopmen t of Phase 1 1 Quan tita the 
Outcome Model (Program and Costh 
Research questions will be addressed 
through construction of a quantitative 
model of day care which links final out- 
come, process, program variables, and 
background covarlables and costs using 
standard techniques of statistical infer- 
ence. The quantitative mode! will be 
- developed as a sequence of milestones, 
beginning with T1.5 (including process 
measures but not including measures of 
child development), and then T2 (in- 
cluding a limited analysis of change 
scores derived from T1 and T2 tests 
and observations of children). Cost- 
related research questions will be ad^ 
dressed by construction of a financial 
model relating day care costs to princi- 
pal cost determinants, including staff/ 
child ratio, professionalism, and group 
size.' Phase 1 1 1 will continue develop^ 
ment and refinement of the quanti- 
tative model. Results of preliminary 
hypothesis testing and effects estima- 
tion will be used for Phase III planning 
during Phase 11, 

Testing and Validation o f Phase II Con- 
clusions. This task will assess the Internal 
and external validity of the model with 
respect to analytic bias and generaliza^ 
billty. The results will be used to inter- 
pret quantitative conclusions, parttculorly 
for Phase Ml decision-makiny and for 



stre.igthening Phase II and Phasi III 
methodology. 

C. DBvelopment of Phase III Research Design, 
A basic Phase III experimental design 
(including choice of sites, centers, and 
treatment of independent variables) will 
be developed on the basis of the T1 ,5 
analysis of center/classroom proce^ data 
coupled with T1 data base analyses. A 
final, detailed plan, including final speci- 
fications of Phase III dependent measures, 
will be prepared as part of T2 analysis. 



The following discussion relates these tasks to 
the three major analytic periods that divide 
Figure 2-2 horizontally. 

The T1 analysis Is principally concerned with 
developing definitions of variables to be used 
in later analyses, including center characteris- 
tic variables, family background, child and 
parent pre-measures, cost variables, and eco- 
nomic output indices. Data to be used include: 
independent program information (RPIS), the 
parent measures pre-interview (PM1), pre- 
tests from the SRI battery (CT1), the first 
child observation period (C01), and the cost 
system (RCAS). Center program variables 
will be used to structure a profile of center 
characteristics, which form the independent 
variables of the analysis. Analyses of the 
first child observations and the first adminis- 
tratlon of the test battery will be performed, 
concentrating on internal psychometric struc-^ 
ture. Studies of parent attitudes and generali- 
zability will also begin at this time. 

Although the child observatiQn data present 
one portion of classroom process, they are 
not sufficiently complete to construct a 
quantitative model of classroom process. Be- 
cause many children will not have been ex= 
posed to the conditions established by the 
policy variables long enough to eKpect any 
discernible effects, it would be premature to 
consider the effects of the indopendent vari- 
QblQs on pithor process or outcome. Conso^ 
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Figurs 2'2 
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quently, T1 model development will concen- 
trate on the construction and exploration of 
program variables and background covariablK, 

Tt.5 analysis will be a fint step toward aisess- 
ment of the influence of independent variables 
by relating them to classroom process measures. 
This must be preceded by internal analysis of 
the pror^ss data and subsequent construction 
of process variables, principally from teacher- 
focused observations but supported by child- 
focused observation data. The result will be 
development of the classroonn process model. 

Construction of a classroom process model is 
mutivated by the assumption that process 
mediates Qr fosters development. If this as- 
sumption is sound, and if an accurate model 
of the relationship between procesb and de-^ 
velopmental outcomes can be constructed, it 
will be possible to use process variables as 
surrogates for outcome variables in Phase III 
planning. The sensitivity of different process 
measures to the independent (policy) variables 
can be determined directly by observation at 
T1 J. Through use of the model, plausible 
hypotheses concerning relationihips between 
the process variables (hence also the policy 
variables) and developmental outcomes can 
then be constructed. Such hypotheses will be 
developed as far as the data allow, since major 
parameters of the Phase III design must be de^ 
termined before T2 data are available. In par- 
ticular, hypotheses based on the model will 
be useful in choosing sites, centers and experi^ 
mental variations* 



The resulting model will be subjected to a 
full range of testing and power analysis in 
order to generate a set of Phase 1 1 1 hypotheses 
and to provide data for Phase III design deci- 
sions. Validation of variable definitions will 
be carried out, using the process model as a 
basis. Selection of Phase III design parameters 
will follow a set of objective decision rules 
based on the results of Phase 1 1 analyses. 
Site level generalizabillty will be Included as 
one of the criteria for Phase III choices of 
sites and centers. The financial model will be 
completed and the results used in developing 
the Phase III design. 

T2 analysis will focus on the construction of 
final outcome variables and the Phase 1 1 1 
measurement battery. It will make use of T2 
child observation and post-test data to extend 
the analysis from process measures to measures 
of cliiid development and of parent satisfaction 
as final outcomes of the process., Analysis will 
begin with construction of the outcome (de- 
pendent) variables derived from fin analysis 
of the internal structure of T2 data. The asso- 
ciation of these outcome variables with pro- 
cess variables and policy variables will be in- 
vestigated to refine Phase III study hypotheses. 

Testing and validation activities will include 
analyses of attrition and analytic biases, as 
well as a summary analysis of internal and ex- 
ternal validity. Analytiaconclusions will be 
presented in the context of these analyses for 
translation into decisions affecting further 
research activity, including final verification 
of Phase III measures. 
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Chapters! DISCUSSION OF VARIABLES 



The variahles of the NDCS model described in 
Chapter 2 are developed more fully in this 
chapter, which Is orgpnized by variable do- 
mains as follows: 

• Major Independent Variablis 

Policy Variables 
Other Center Variables 

• Background Variables 

Parent, Child and^Household Variables 
Site Variables 

• Classroom Process and Child and Parent 
Outcome Variables 

• Financjal Outcome Variables 

MAJOR INDEPENDENT VARIABLES 
The Thfee Policy Variables 

The independent variables include three major 
policy variables - staff/child ratio, classcoom 
staff professionalism, and group size — and 
also other potential major determinants of out^ 
come,* At the end of Phase fl, each of these 
variables will have been operationalized and a 
subset of them chosen for analysis in Phase III. 
The variables and the approach to this task 
are described below, 
%. ' 

Staff /Child Ratio: Although staff/child, ratio 
is a major cost determinant and program vari= 
able, it is often discussed, and even regulated, . 
without being defined operationally. Several 
different operational definitions will be formu^ 
Jated during Phase II and tested both as poten- 
tial predictors of costs and child outcome, and 
also for definitional simplicity and ease of 
regulation. 

A simple definition for staff/child ratio would 
seem to be the average ratio of children to 
adults in a class group. Most regulations assume 
this definition. There are two immediate prob- 
lems - the child may be with an identifiablo 
core group for only part of the day (in fact, ' 



*For a full (lisciissjon of thuso tfiroo vorlablos sog 
both Chapters 2 and 3 of Vulumn I. 



that is usually the case), and children within 
a group may experienae quite different effec- 
tivf ratios in terms of the attention they tb- 
ceive from adults. A child may begin her day 
in a free play group with a low staffing ratio, 
join her core group with a higher ratio and 
then join an activities subgroup. Her nap may 
be relatively unsupervised and she may^rejoin 
a large group for parent pickup. What is the 
appropriate ratio? An integrated ratio may 
overemphasize nap time and entrance.and 
e)^it periods, at the expense of the core period 
of the day, when most developmental activities 
m^y ^ake place. A core day ratio may over- 
weight a two-hour portion of the day, ignor^ 
ing six hours of less supervised activities. With- 
in a group, the child may bt playing alone, in 
a smill unsupervised informal group or in a 
supervised small activity group. Thus, the 
effective contact ratio cannot be acrurately 
portrayed by a sing! . definition of atio. v 

On the other hand we may be interested in the 
staff/child ratio as ft is generally described in 
state and federal regulations. This ratio is gen^ 
erally computed as the ratio of the number of 
child care staff members to the number of 
children in a class. Regulations focus on the 
minimum staff/child ratio allowable rather 
than the actual amount of adult-child contact 
during the day, although the amount of con^ 
tact may be more important In the develop- 
ment of children. Ambiguities appear in the 
treatment of volunteers and aides who do not 
regularly appear every day, or work only part 
of the day. 

The 1968 FIDCR regulate staff/child ratio in 
federally^subsidized centers but do not explain 
it precisely. A day care center is defined as a 
facility serving groups of more than 12 child^ 
ren, to which the following regulations apply: *' 

Day Care Center 

a, Three^ to four-year. No more than 15 in 
a group with an adult and sufficient 

*no{julniions citod uru (juotoci from FiHlanil Intm- 
uuonay Day Canj Hct/aimnwnts DHEW (1968), 
which IS briofly cinaly^fHj in Chuplur 2. VoIuitk? I, 
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assistants, supplemented by volunteers, 
so that the total ^tio of children to 
adults is normally not greater than 5 to 
1, 

b. Four- to six-year. No more than 20 In 
a group with an adult and sufficient 
assistants, supplemented by volunteei's, 
so that the total ratio of children to 
adults is normally not greater than 7 to 
1. 

SiX'through 14 year. No more than 25 
in a group with an adult and sufficient 
assistants, supplemented by volunteers, 
so that the total ratio of children to 
adults is normally not areater than 10 
tol." 

A footnote adds the following information: 

'The^adult is directly responsible for 
supervising the daily program for the 
children in her group and the work of 
~ the assistants and volunteers assigned 
to her. She also works directly with 
the children and their. parents, giving 
as much individual attention as possible. 

Volunteers may be used to supplement 
the paid staff responsible for the group. 
They may include older children who 
are often highly successful in. working 
with younger children. Caution should 
be exercised in assigning teenagers super- 
visory 'responsibility over their peers/' 

But these regulations leave the actual compu- 
tation of a ratio In doubt. For example: 

• What does ''normally'' mean? Should 
average attendance be used or peak 
attendance? HowWpart-time children 
figure in? What time of day is implied? 
Do the regulations apply to each hour 
of each day, or to weekly averages? 
How, in other vyords, is the number of 
children to be ci^mputed? 

• How is the number of teachers to be 
computed? Do vplunteers count in the 
ratio? HIgh-schobl-age assistants? How 
do part4ime volunteers figure in? How 
do hour^to-hour, day-to^day working 
schedules enter the computation? 



In 1972, OCP drafted a revision of the FIDCR 
(not implemented). These draft requirements 
were sensitive to the fact that the actual ratio 
of caregivers to children does vary through the 
day and week and could have reduced the am- 
biguity of the 1968 FIDCR.- The 1972 draft^ 
described the computation of the ratio to be 
regulated, as follows* 

The basic ratio assesses total child hours against 
total caregiver hours, with the following rules. 
The ratio is computed by dividing total child 
hours by total qualified caregiver hours. Volun- 
teers and high-school-age aides do nor count In 
the ratio. The computation is at the center 
level. 

There are thus several different formulas by 
which staff/child ratio may be measured. 
Each is defensible from some point of view, 
but if we are interested in effects on children, 
then we are interested in measures assessing 
the frequency and duration of contacts with 
adults throughout the day such as the coniact- 
hour ratio, which compares the total number 
of daily child hours with the total number of 
caregiver hours. This definition is also logic- 
ally extendable to the day care year by esti- 
mating average yearly contact ratios on the 
basis of several time point measurements. We 
will test all alternative ratios both in terms of 
their relation to each other and their influence 
on child outcomes: 

9 In order to measure head-count ratios 
that can be implemented by regulation, 
several different techniques will be em- 
ployed for weighting fulh and part^time 
children and full- and part-time staff, 

• In order to examine process^orlented 
ratios, several techniques will be used to 
estimate contact ratios using more de- 
tailed program data and also the class- 
room process data gathered by observa- 
tion. These data will also allow some 
assessment of the variation in contacts 
among children in the same program. 
Each potential definition must be a 
plausible one independent of the actual 
data and particularly of child outcome 

2 1 ^^^^3- 
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Not all of these definitions can be directly 
manipulated by policy regulations. For in- 
stance, it would be difficult to mandate the = 
number of caregivers by type of activity. and 
impossible to mandate the amount of care^ 
giver contact time each child must receive 
each day. There are two important reasons 
why it h desirable to identify the relationships 
among the various definitions of staff/child 
ratio that can be controlled and the actual 
measured staff/child interactions taking place 
in classrooms which cannot be controlled 
directly.* First, the most powerful of these 
relationships will be used in the analysis o,f 
the influence of ratio on both process and 
outcome. Second, to the extent that ratio 
is influential, these definitions can be used 
in developing more adequate monitoring pro- 
cedures for day care licensing and quality 
..controL Therefore, each measure of ratio 
will be systematically related to all others and 
will be examined by center characteristics 
(size, auspices, organization, etc.) and by 
site. ' ^ 



Professionalism: Professionalism is also a 
complex measure that may mean different 
things as a regulatory measure and as a pre^ 
dictor of child outcome. Professionalism is 
also complicated by the fact. that a single 
measure may not apply equally well to cen^ 
ter directors, teachers, assistant teachers, anti 
aides. Regulatory authorities customarily 
set rninimum requirements for profesiional 
qualifications for directors, teachers, and 
aides. Gerfferally these regulations cover 
several or all of the following areas: 

• Chronological age, 

• Ability to read and write, 

• High school diploma or equivalent, 

• B,A., Graduate degrees in general yreas. 

• B.A., Graduate degrees with concentra- 
tion in early childhood development, 
education, or related areas, 

• Years of education toward general or 
early childhood^speciflc degrees, 

• Participation in workshops and special 
courses, 



• Experience in general early childhood 
care, . 

• Experience in early childhood group 
care. 

In one state, for example, day care personnel 
must be/'qualified through training and experi- 
ence to provide good physical care, maintain 
responsible supervision, and provide meaning^ 
ful experiences to promote the total develop- 
ment of the children enrolled." This require- 
ment would be unlikely to exclude. many 
potential personnel. Another state regulates 
the educational level of staff according to size ^ 
of center. For small centers — 7 to 15 child- 
ren — the director need be only 1 8 years old 
and have a high school diploma. For medium 
centers — 16 to 39 children — the director also 
needs one year of experience in family or 
group day care. For larger centers, the direc^ 
tor needs three years of experience in group 
ca*"e, or one year of college and two years of 
experience, or a B.A. or the equivalent. Teach- 
ers must be at least 18 yeare old and have a 
high school diploma or the equivalent, white 
aides need only be 15 years old. 

Yet another state evaluates each center's staff 
with a point system to develop an overall 
quality rating. The director is assessed by 
the following formula: seven, points for a 
graduate degree in early childhood education, 
five points for a B.A. with relevant concentra- 
tion, one point for each year of post-secondary 
education up to four points, one point for each 
two years of work experience with young child- 
ren up to a maximum of three points, and one 
to two points for regular attendance at work- 
shops or special courses. Teachers are given 
fewer points in the same areas, except for 
graduate work. Aides are evaluated only on 
experience (two points), workshops (one 
point) and eighth grade or better education 
(one point). Such a formula could be used 
directly In statistical, analysis, since the scales 
are numericaL 

These examples show the extreme diversity of 
requirements across the states, each sot of 
regulations making concrete a state's thooretl^ 
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cal construct of day care professionalism. An 
important task of the NDCS will be to unify 
these concepts of professionalism and to oper= 
ationalize the concept in one or more dimen^ 
sions. 

Operational definitions used in the analysis 
will depend on the Same fundgmental measures 
as do the regulations. Both nominal and inter- 
val variables will be considered. For example, 
years of eduction and possession of a high 
school diploma might be considered alterna- 
tive measures of education. Nominal variables 
mSy be useful analytically especially when the 
threshold is set to equal some important 
"breakpoint" in the response to the indepen- 
dent j^ariable, but we would usualjy eKpect. 
better predictive power from interval scales. 
The results of analysis of interval variables 
may suggest good threshold values for regula- 
tions. 

Before the various definitions of professionalism 
can be used to measure caregiver behavior in 
the classroom and/or child outcomes, it is 
necessary to know how these measures are 
distributed in our several samples and how 
various components of the definiti^on of pro- 
fessionalism relate to the proeess variables. 
The cor ribution'of various levels of caregiver 
education, experience, and in-service training 
to types of classroom processes will be assessed, 
and findings will be presented by site and by 
type of center: public or private, profit or 
non-profit. 

Group Size-' Group or cfass size is the number 
of children assigned to a common physical 
home base — an area or classroom — under 
the regular care of the same caregivers, An 
intact group mBmtalm its identity through- 
out the day while a non-in tact group may at 
times merge with others. When children be- 
long to a non-Intact group, their group size 
will be defined as the number in the group 
during the middle of the day. 

Child groups are either singlo-ngQ or mixed- 
age. Study age is defined as the child's age at 
entry during the current school year — Septom'^ 



ber 1 to August 30. Thfe group age span is the 
span between youngest and oldest childreri. 
In mixed-age groups, fo^. instance, there might 
be a 21 -month age span from 2 years 9 months 
- to 4 years 6 months. ^ 

Group size has been chosen as an independent 
variable because it is an easily-measured para- 
meter of center organization. Ambiguities 
are few but include the effect of absences, 
changing size over the period of the study, and 
changing size over the period of the day. Final 
operational definitions will be constructed to 
provide high analytic power and to make 
theoretr^l and intuitive sense. 

Other Center Variables 

Other center-level va^^iables may also influence 
outcomes. The most prominent among these 
variables are auspices, size, source of funds, 
director professionalism, curriculum orientation, 
in-service training, organizational dynarrilcs, 
parent involvement, and 'supplementary services. 
A very few of the likely candidates will be con- 
: sidered as additional independent variables for 
use in Phase II analyses. If any of these vari- 
ables prove especially critical, then someVe- 
orientation of Phase III may be desirable, but 
it is likely that such variables need only be con- 
sidered explicitly In the analysis without affect- 
ing the design. 

• Auspices: The legal organization and 
economic status of the center. All major 
forms of auspices are represented in the 
study population. Included are propri- 
etary, individually-owned and corporate- 
ly-owned centers; not-for-profit churches; 
voluntary community agencies; schools; 
federal, state, and local government cen- 
ters. 

• Si^e: Total center enrollment. 

• Source of Funds: Predominant funding 
through parent fees or public money, 

• Director Professionalism: The training 
and experience of the director and such 
other indicators of professionalism that 
can be roadily capturod (e.g., director 
time use). 

2^1 
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• Curriculum Orientation: Orientation to- 
ward custodial or developmental care. 
The variable requires an adequate opera- 
tional definition based, upon RPIS data 
data systems. 

• In-Service Training: The frequency, dura^ 
tion and content of staff training events 
conducted by the center or other organ- 
izations. 

• Organizational Dynamics: The formal 
and actual center decision-making struc= 
ture and processes. 

• Parent Involvement: The frequency, 
durat.on and content of center-organized, 
individual or group parent activities, 

• Supplementary Services: The type and 
quantity of suppiementary services to the 
child (health, nutrition, etc.) or parents 
(social services, employment, etcj. 



BACKGROUND VARlABLiS 
Parent, Child and Household Variables 

Parent, child, and household characteristics are 
important as uncontrollable independent co- 
variables which may affect outcomes. It is crit- 
ical to the analysis to take account of family 
characteristics, attitudes, and history which 
may be predictive of child outcome. The use 
and power of such child-level covariables in 
the an^alysls are discussed in the. next chapter, 
The following constructs are under current 
consideration, although others may emerge 
as equally important after Phase 1 1 analyses " 
are complete. 

Child's Previous Expefience with Day Care. 
Adaptation to the day care social environment 
is' most rdpid during the first few months, and 
children who have already largely adapted 
will show less development between T1 and 
T2. If these children are to be compared to 
children without previous day care experi^ 
ence, such experience must be taken into ac^ 
count, 



Parent Expectations and A ttitudes. These co^ 
variables will include parenfs' perceptions of 
" their children's problems, attitudes toward 
center services, disciplinary practices, school 
readiness, and a study of parent cultural back- 
ground. 

Parent Perceptions of Children's Characteris- 
tics such as persistence, aggression, curiosity, 
autonomy, and dependency may be useful 
predictors. 

Family Characteristics such as family struc- 
ture, income, education and occupation may 
be equally powerfuL The most familiar of 
these variables is the composite variable, 
socioeconomic status (SES). SES has different 
operational definitions, all directed toward 
measurement of a concept of status which is 
not exhaustively defined or definable, but 
traditionally includes assessments of econo- 
mic status, occupational status, and educa- 
tional status. In the National Day Care Study, 
SES is being estifnated from data gathered 
during parent interviews or from short tele- 
phone inquiries. Preliminary analysis d'f the 
data has shown that mWi^r's educatiorrand 
family income have good distribution and 
are not weakened by excessive missing data, 
These variables may be combined as a compo- ^ 
site measure.of SES or may alternatively be 
retained as separate variables, d^ending on 
their explanatory power. 

Site Variabloi 

The relationships between site and day care 
center may systematically influence center 
process. These possible influences will be 
considered, to allow us to interpret differ^ 
ences among the three sites.* This section 
presents some of the theoretical constructs 
that will be used in an examination of the in- 
fluence of site on centers. 



*Tho possible uximnm of a ''siio yffuct*' on parunt 
and child outCDinus, v^ith Us implications for the 
yGnerali^abifity of study rBSUlts, has emurnod as an 
important muc for Phaso II and Phasu III, Both 
Chaptor 3 of this volumo and ChapiGr 4 of Volumo j 
havo a fuller discussion of this issuo, 



The following site variables will be considered 
in interpreting both Phase II and* Phase III 
results: 

• Political Variables: 

a. Structure of official, political and admin- 
istrative organizations relevant to day 
care; 

b. Representation of neighborhoods in city- 
wide and metropolitan day care organi- 
zations; ' . 

c. Role of political parties in day care^ 
^ affairs; 

d. Pclajor civic, voluntary and social organi- 
/zations active in day care affairs of the 

site; 

e. Characteristics of site political leaders 
and other influentials and their involve- ^ 
ment in day care. 

• Economic Variables: To the extent po^ible 
^ a profile of major economic units in the site 

will be developed by type of industry and 
by type of occupation, enumerating individ- 
uals employed in the categories of profes- 
sional, laborer, manager, etc. U,S, ^Census' 
definitions of Occupation and Industry will 
be used. This will allow us to relate parent 
data to the broader employed population. 

• Demographib Variables: Census data will 
bemused to establish a better understanding 
of the composition of neighborhoods with- 
in which study centers operate. 
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CLASSROOM PROCESS AND CHILD AND 
PARiNT OUTCOMi VARIAiLES 

The complete specification of classroom pro- 
cess and child outcome variables for Phase 1 1 1 
cannot be accomplished until all appropriate 
measures and constructs have been identified 
and instruments selected and tested, a Phase II 
analytic task, OCD approved a preliminary 



group of constructs, associated measures, and 
an instrument battery fc^ the Phase I I pre-test 
(T1 and 71.5) as recommended by SRI with 
Abt's cbncurrence,* 

The primary consideration in jeleTcting both 
process and outcome variables flows iProm the 
central question of the National Day Care 
Study: what are the effects of the policy vari- 
ables, includingstaff/chlld ratio, professional- 
ism, and group size, on both classroom pro- ^ 
cesses and children? Since assessing this re- 
lationship is a central goal of the study, it was 
necessary to identify those classroom and child 
behaviors which could realistically be expected 
to reflect the set of experiences provided to 
children in day care centers. Extreme care was 
taken to avoici selecting process and outcome 
measures which would measure behavior in 
children irrelevant or incidental to these ex- . 
periences. Selection of such variables could ^^ 
prdduce the erroneous result.of a failure to re- 
ject the null hypothesis conGernIng the: true 
effects of variations on the policy Variables 
under study. Center selection procedures 
have ensured that variatioris in the pglicy-rele- 
vant variables will be highly visible, Since 
Phase III will be an investigation of the effects 
of manipulating such variables, Phas844^ust 
determine systematic relationships among 
policy, process, and outcome variables to pro- . 
^vlde a strong foundation for Phase 1 1 1 hypo- 
thesis testing. 



*The instrurnents selected ate: 

Observation Instruments 

PresGOtt-SRI (child^focused) 

SRI (adult-focused) , ^ ' ' 

Test Battery and Associated InstrumGnts 
64 Item Preschool Inventory (PSI) *^ilh ' 

HertEig Birch scoring 
McCarthy Verbal Memory Tost (MVMT) 
Motchinfj Familiar FigurGs (MFFT) 
Pupil O^iservation Checklist (PDCL) 

A brief disGUsaion of those instrumonts cow be found 
In Anpefidi?< B of Volume 1, First Annual Report. 
A report by Shi providing a fuH description of uach 
instrument and field test results will tap nvnilable in 
June. 
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A second consideration in the selection of 
variables is that of social relevance. Several 
different donstituencies — parents, caregivers 

, and federal officials — have interebts^and 
values'that ihoiild be reflected in the results 
,of this study, Nearly all groups and individuals 
involved in^the world of child care are con- 
cerned that no damage be done to children in 

' pubHcty-fiinded institutions. Data demonstrat- 
ing that fnrollment in day care centers regulat^ 
ed by tfte FIDCR does not result in physical, 
cognitive/or emotional harm to children will 
be i^nportant to policy-makers, parents, and 

. caregivers, whether or not positive effects of 
daycare may be clearly demonstrated. 

Another consideration is that effects of vari^ 
' ables should be.observable over a period of 
approximately six. months from pre- to post= 
testing in Phase II, Although the study is not 
primarily longitudinal, there will be a few child- 
ren who enter day care as three^year-olds and 
reappear in Phase III as four-year-oids to pro- 
vide a small, longitudinal sample that should 
riot be ignored analytically. Measures selected 
must nevertheless be sensitive to short-term 
changes for the majority of the study sample 
of children if they are to provide adequate 
data in Phase IIL 

A fourth consideration is the desirability of 
'generating normative data about the impac^ 
of various center characteristics. Since this 
, study is directly concerned with^the cost of 
effects, i^t must trade costs off against the 
relative \^alue of those effects. Some effects 
may be i/nportant in th&statistical sqnse but 
may be trivial from a developmental point 
of view. (A gain of two points on the PS1 
may be Itatistically significant> but of no 
practical significance to the growth process 
of children and may not be worth the money 
or effort to achieve.) The preferred approach 
is to use instruments to "measure variables for 
which normative data are available so that 
change in the day-^care study population can 
be\assessed against change in an independent . 
general population of subjects, This way., the 
importance of change In developmenttil terms * 
as well as In statistical terms can be assessad. 



% Finally, instruments used to assess process 
and outcome variables m jst be psychometric= 
ally sound. Some of thf. technical criteria 
applied are'^i .... 

1* Testing and observation periods should be 
short enough so that^children will not^be^ 
come exhausted or irritated, and instru- 
ments should be attractive enough that 
test-taking anxieties do not interfere with 
performance; ^ 

2, Tests should be appropriate for both three- 
and four-year-olds, so that norms and 

^hange scopes spanning the full two-year 
™ange can be established. 

3, Tests should have adequate test-retest and 
inter-rater reliability no lower than 0,6 and 
preferably higher. 

4, There should be an extensive body of know 
ledge associated with each test's experimen- 
tal history, including available norms by ' » 
age and by sex. 

5, Instruments should have adequate content 
validity, , ■ ' 

"Adequate*' test-retest reliability, inter-rater 
reliability, and content validity are not rigor- 
ously defiried quantities. , The scarcity of 
measures for three- and four-year-olds may 
dictate some Jlexibility in accepting low values 
for these measures if the instrument is other^ 
wise superior. In practice, values as low as. 
0.6 rnight be accepted for the psychometric 
reliabilities. 

The two major categories of variables djscussed 
in this section are classroom process and child 
outcotm. They are considered together be- 
cause classroom process is.not only the link 
between the independent variables (center 
characteristics) and child outcomos, but also 
Is an important outcome in and of itself.' 

Classroom ProcHbs VariabiGs 

Two kinds of process variables, structunil:mi\ 
psychouducatloiwi, are being consldorud lii 
the NDCS:^ 



1. Structural Process Variables describe the 
organizational and management dynamics 
of the classroom, including frequencies and 
durations of interactions between children 
and carefm urs. The variables in this cate* 
gory inuiude: 

a. Activity Structure of the class, referring 
to the balance between caregiver-defined 
programs (organized instructional periods, 
group play activities) and child-determined 
activities (free play or unplanned programs; 
constrained only by physical spacl^and . 
materials available to the childrerih 

b. Class Subgcoupings., This variable refers 
to the, size/and number of subgroups, 
their pefsiitence 0|er time, and the ex- 
tent to which they'are spontaneously 

' . formecl By the children or created by the 
.caregiver, 

.c. ^f^ates of Interaction between children 
and caregivers. These Involve estimates 
. ' of>atps of interaction within content 
categories such as: 

• Social interaction /social skill acqui^ 
si^ion 

' " • In^ra-persona! control t 

• Cognitive/language skill develop- 
ment 

• Physical skill devejopment 

These aspects of classroom organization refer 
less to the psychological content of classroom 
events than to their structural character. Signi- 
ficant variations in these structural properties 
are associated^with staff/child ratios and the 
professional preparation of the caregivers (df. 
Prescott, 1967). Large icenters tend to demand 
that relatively more attention be paid to manage 
ment issue? than interpersonal relations between 
caregivers and children, but this dynamic de- 
pends on individual caregiver style, physical 
resources available in the center, the size of 
classes, and number of caregivers available fon 
managerial tasks. • - 

2. Psychoeduc&tional Process Variables, The ^ 
most pervasive child effects are expected to 
emerge in the social aspects of behavior; 



so it is important to measure caregiver be* 
haviors that can be related to variations in 
social behavior among children, such as: 

a. Statements of rules and constraints, both 
those imposed by the physical environ* 
ment and those dictated by social con= 
vention. 

b. Discussion and explanation of restrictions 

c. Assertion of arbitrary restrictions 

d. Distinction between 'motives and acts, 
feelings und behaviors^ 

e. Punitive or non-punitive techniques for • 
'^administering discipline ^ 

f. Rate and mode of interaction with child- 
ren and with other adults, including 

' 'openness to physical contact 

g. Classroom management technigues 

h. Provision of materials and classroom struc 
ture " ' ^ 

Classroom process variables; .to a large degree, 
reflect the Independent variables as they are 
Implemented in the classroom. Staff/child 
ratio, group^size, and professionalism foster 
the emergence of certain interaction patterns, ' 
both structurally and psVchoerfucatlonally. 
Certain of the structural process variables, ■ 
such ai the number of child-caregiver inter- 
actions per hour, wilLbe very sensitive to 
policy variables such'as the staff/child ratio. 
It is also Important to identify the day care 
experiences that most Infljjence the emotional, 
social, and cognltive^growth'of children. A 
child in day care^experlences many.new situa- 
tions — unfamiliarLadults are guiding him/her; 
- he/she must share facilities and equipment 
with, other children; and he/she.must also 
|hare the caregiver's attention with other 
children. Psychoeduoatibnal process vari- 
ables will be Used to describe the nature and 
effects of such experiences on the develop- 
ment of children in day care. Child outcomes 
ar§ the measurable effects of both day care^ 
processes and normal development on child 
behavior. ' : 



Again, cafecjivf?r behaviors will be considGred 
both as constK|uences of the policy variabltss 
and as antecedents of child butcomes. Analy- 
tic plans discussed in the next chapter are de- 
signed to accomplish both of these tasks, 
thus establishing a strong base for generating 
Phaso 1 1 1 hypotheses. 

Child Outcome Variables 

A short summary of the child outcu tie vari- 
ables that have been selected follows. Abt 
and SRI have jointly arrived at (a) a set of 
criteria for selection of variables; (b) a justi^ 
fication of each selected variable in terms of 
these criteria; and (c) operational definitions 
of the variables which allow them to bd linked 
to specific measurement instruments. These 
matters are discussed in greater detail in a re- 
port to be published by SRI early in June of 
1976, As the SRI report will make clear, 
there are conceptual and measurement issues 
still to be resolved regarding some of these 
variables; therefore, the list must be regarded 
as subject to some revision. However, con- 
siderable care has been devoted to selection 
of the present list, and major changes are not 
dnticipated. The SRI report also discusses a 
number of additional child outcomes for 
.which assessment might be desirable but has 
not proved feasible for a variety of reasons. 

■ principal groups of child outcome vari- 
es are currently being utilized = social/emo= 
uonal, cognitive/linguistic and physical/motor, ^ 
As will be apparent, some of the behaviors 
under investigation relate primarily to the 
issue of potential harm to children in day 
?re (e,g,, incidence of anger and hostility^ 
d some primarily to positive development 
g., self-assertive interaction with adults and 
other children^ while still other s may reflect 
harm or normal development depending on 
the degree and manner in which they are 
manifested (e.g., dependency). !t is for this 
reason that harm is not treated here as a 
separate variable to be assessed. In more de- 
tail, the three outcome variable groups may 
be broken down as follows: 



1 . Socml/Eniotional DovalopirmtUdl Vcftidbhs 

a. Diipendency: Behavior reflecting the 
child's needs for instrumental assistance 
and/or emotional comfort in problem 
or stress situations, 

b. AutatiOiDy: Behavior reflecting the 
child's efforts to deal with his world in 
an independent fashion, e,g., by initiat- 
ing interaction with others, exprfissing 
'his views or asserting his rights (such 
betiavlor is to be clearly distinguished 
from the hostile or destrLictive l}ehdviur 
mentioned below). 

c. Aggression: Anger, hostility and nega- 
tive behavior- toward adults, other child- 
ren or the environment. Though a cer- 
tain amount of anger is presumed to be 
healthy and normal in pre-school child 
ren under appropriate circumstances, 
consistent high levels of hostility or 
destructiveness may be taken as indices 
of difficulties in the child, the centt^i or 
both. 

d. Self Control: Behavior reflecting the 
child's ability to master his impulses. 

0, Social Invoivemnnt: The degree to 
which the chili^ nteracts with adults or 
other children, single and in groups. 
This variable is designed to capture an 
important effect attributed to group 
care situations, namely an increase in 
the child's ability and propensity to 
deal with others. This variable also re- 
flects the child's willingness to partici- 
pate, and pleasure in participating, in 
the activities of the center, 

f, Prosocial Behavior: Cooperation, help 
ing, or generosity shown toward other 
children or adults. 

g. Compliance/Obedience: Acceptance of 
adult judgment and of rules governing 
behavior in the center, 

2. Linguistic and Cognitive Deye/opmentat 
Variables 

a. Cognitive skills and content learning 
i. Language skills: vocabulary, syntax. 
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ii. Momory: especially short=term 
verbal memory^ a sponific mnemonic 
skill relevant for school-related tasks. 

iii , Spocfffc skill and concept learning: 
familiarily with everyday concepts, 
e,ti., odor, sfiaf^e, size, number, time; 
ability to follow directions and to 
do siinple recocjnition and reasoning 
tasks, 

b. Cognitive Style 

\. Reflectivity: The tendency or tibility 
to defer inn mediate response to a 
task or question in order to test al- 
ternative responses mentally, so as 
to arrive at the best overt response, 

ii. Task persistence: Ability or willing= 
ness to keep at a task despite frustra^ 
tion or temporary inability to per- 
form correctly. 

iii. Generation of ideas: Facility in in= 
venting novel forms of behavior, 
e.g., in imaginative play, storytelling, 
artistic creation, etc, 

iv. Problem solving: Flexibility and 
effectiveness in recognizing and 
overcoming obstacles or difficulties, 

V, Curiosity: Exploratory behavior; 
active, self-motivated discovery of 
new features of the environment. 

3. Physical and Motor Development 

Physical growth of children has not proven 
sensitive to program variation in other 
studies and is not expected to relate to the 
independent variables of the present study — 
staff/child ratio, professionalism and group 
size. However, several variables relevant to 
physical and motor development will be in- 
eluded, 

a. Self-help skills: The child's ability to 
cope with his own needs, e.g,, dressing, 
feeding and cleaning himself, etc. 

b. Safety and health: Accident rates and 
absenteeism due to sickness will be docu- - 
mented and examined as possible indices 

of physical harm. 

2j 



Clearly tlie above list omits variablos wliich 
are important in tlie total development of 
the child and which miulit be included in an 
ideal test battery, e.g., self =concept. As will 
be made clear in the SRI document, such 
variables have not been included kirgely bo 
cause of the difficulty of finding psychometri' 
cally sound measurement instruments appro- 
priate to the age=range and ethnic diversity of 
the sample, as well as to the practical condi^ 
tions under which tests must be administered 
In a national study of the scope of NDCS. 
However, we are continuing to explore the 
possibility of locating appropriate measures 
and adding one or more of thtise variables to 
the Phase III measurement battery. 

Parent Outcome Variables 

Parent outcome variables to be considered in^ 
elude the following: 

Parent Involvement, Will be defined operation- 
ally by numbers of visits to the center and par- 
ticipation in center activities. This variable is 
important as an outcome and as a dimension 
of day care process. 

Parent Satisfaction. Another important ouc- 
come variable, to be indirectly evaluated from 
responses to questions about the characteristics 
of center care, parental use of the resources of 
the center, and parents' perceptions of the 
ability of caregivers to deal with children's prob 
lems. 

Impact on Parent. Parents' ability to deal with 
problems, employment and so on. 

Impact on Child's Behavior. Parents' percep 
tion of day care's impact on the child. 



FINANCIAL OUTCOME VARIABLES 

The primary objective of the financial analysis 
will be the determination of the effects of 
policy variables on the per^child cost of day 
care. Considerable attention will also be paid 



to the effects of policy variables on the aver- 
age compensation received by caregivers, on 
the percentage distribution of expenditures 
across budgetcategories, on fees charged to 
privateiiay day care customers, and on a 
variety of other financial indicators. The nia^ 
jor financial indicators that will be studied 
durinc] Phase II for sensitivity to variations in 
the policy variables are: 

® Total resource cost per child: Value of 
all resources used in the provision of child 
care (including in^kind donations) divided 
by alternative measures of the number of 
children served. .Among these alternative 
measures are fulhday^equivalent child days 
according to enrollment schedules and iuW- 
day equivalent child days accoiding to at^ 
tendance records. ^ . 

* Net earnings per child: Total income less 
total resource cost divided by alternative 
measures of number of children served. 
This variable is an inlportant outcome 
measure because it indicates whether (and 
to what degree) the center, is making a pro= 
fit, breaking even, or incurring a loss on 
the average child, 

• Total contributions as a percentage of total 
resource cost: The sun^ of cash and in^kind 
contributions, foundation grants, allotment 
from federated fund-raising companies, etc., 
divided by total resources used in the pro= 
vision of care. This variable is important 

as an indicator of the dependence of centers 
on income other than paV^ments for child 
care services. ' 



e Occupancy, equipment, and tnaterial costs 
per child: This variable should serve as m 
index of another measure of program en= 
richment; in-kind donations would be in= 
eluded in the cost measure, 

© Average tuition rate to private-pay custom- 
ers: Average fee charged to parents whose 
child care is not paid for with federal funds 
This variable can be used to measure the 
indirect effects of variations in policy vari= 
ables on the price of child care to those 
not federally subsidized, 

« Average compvfisation per caregiver: Two 
measures^will be used for this variable, 
average gross salary and average gross 
salary plus fringe benefits. Estimation of 

^ the effects of policy decisions on these 
compensation variables is important as 
an intermediate step in estimating the im^ 
pact of policy decisions on total child 
care costs. Compensation variables are 
also outcome variables in their own right, 
since part of the benefits provided by the 
day care^industry are the employment 
and income it creates for its employees. 

• Value of non-administrative professional 
seryices per child: Value of all professional 
services paid for or received as in^kind dona^ 
tions other than services directly related to 
center administration (lawyer, accountant, 
etc J divided by alternative measures of the 
number of children served. This variable 
should serve as an index of one aspect of 
program enrichment; as such, its sensitivity 
to variations in policy variables is important. 
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Chapter 4- RESEARCH AND ANALYSIS 
METHODOLOGY 



This chapter presents study methodology in 
detail. Discussion covers gerieral consideration 
of analytic issues and a task^oriented plan for 
developing a quantitative nriodel of child and 
cost outcomes. 



GENERAL DISCUSSION 

A quantitative model of child outcomes and 
center costs is being constructed so that the 
Phase II research questions can be addressed 
and hypotheses for Phase III testing can be 
developed. Multiple regression will be used 
to relate center-level independent variables, 
background covariables, process variables, 
and both child and cost outcome variables. 

A diagram of the model, presented in Figure 

4-1 ,Thatcat8S the four levels of ^nalyiis. 

(site, center, classroom, child) and the logical 
progression from independent variables and 
covariables through process variables to out- 
comes; and also from independent variables 
and covariables directly to outcomes. The 
arrows express the relationships which might 
be assumed in a particular model. Center 
characteristics and child/family variables are 
assumed to produce variation in center pro- 
cess. Child outcomes are directly influenced 
by process (and thus, indirectly by center 
characteristics and child/family variables), and 
directly by client-level variables. Data are 
being assembled at the child level and pre- 
liminary analyses will be conducted at that 
level. However, many of the important policy 
questions are at the group, center, or even 
site level. This analytic interest in the group, 
center and site does not conflict with the 
choice of the child as the basic unit of analy= 
sis required if best use is to be made of child 
test data and child/family covariates in regres- 
sion analysis. 



The model will analyzed principally using 
the SPSS* software package. The analysis 
will treat each child m a ''case/' linking center 
and group data to ea case. All of the child- 
ren in a group will have the same values for 
center and group data; all of the children in a 
city will have 'hat site's identifier variable. 
In this manner a hierarchical model will be 
structured as a chi'd-level regression. At the 
same time group, center, and site level analy= 
ses will be possible through aggregation to 
those levels, 

The strongest argument that the child should 
be the basic unit of analysis is built on expec- 
tations about the fractions of variance in out- 
come which may be accounted for by differ- 
ent factors. A large fraction of the total vari- 
ance in child outcome will be accounted for 
by child-level characteristics such as previous 
experiences, developmental age and family 
backgrouna. When data are aggregated to 
group or center level, the information con= 
tained in child-to^child variations in outcomes 
and characteristics is lost, but if a substantial 
part of the total variance in outcome may 
be accounted for by child-level factors, the 
analysis of center and group^level effects is 
made more powerful. Although this improve- 
ment will not be dramatic, it is important. 

A similar analysis occurs in the Coleman re- 
port,** where a typical finding presents the 
percentage of variance in verbal ability for 
white school children attributable to different 
combinations of factors: 

School-to-school differences 13.7 percent 

School-tq-school plus child 

background factors 23.0 percent 

SchooUto-school plus back- 
ground factors plus child's 
attitudes 36.0 percent 



*Norman H, Nie, et aL, Statistical Package for the 
Social Sciences, McGraw-Hill, New York, 1970. 

'*Jarnes Coleman, et aL, Equality of Educational 
Opportunity, DHEW, Washington, D,G„ 1966, 
Data are adapted from Table 3,221.1. 
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Figure 4-1 
Diagram of Regression IVIodel 
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If the data were aggregated. to school level, 
analyses would Compare the 13.7 percent of 
variance accounted for at this level to the ap= 
proximately 86 percent which is not. On the 
other hand, if child level variables are also in= 
eluded, only 64 percent of the variance will 
be unaccounted for. This increase in ''signal 
to noise ratio" increases the statistical power 
of the analysis.* 

Many of the variables, including the policy vari^ 
ables, are best defined at the group level, bV 
though the group level presents analytic draw= 
backs that the child level analysis does not. 
Groups do not appear sufficiently stable in 
composition: teachers come and go; children 
enroll and withdraw; groups are merged and 
terminated; and new groups are initiated. If 
these problems are so severe that group level 
analyses are threatened, the group will be 
used only to define the policy variables for 
each child at a given time. 



DEVELOPMENT OF THI PHASE II 
QUANTITATIVE MODEL 

Following the schematic of Figure 2-2 in 
Chapter 2, this section presents the step-by- 
step Phase II approach to construction of a 
quantitative model of day care. The effort 
is divided into three stages that follow the 
availability of data on Independent variables 
and covariables (T1 ), classroom process vari-^ 



*Child^level analyses raise some technical questions. 
Since correlations must be expected among child^ 
ren in the same class, some of the basic assumptions 
of child-level statistical estimation are violated. 
Ordinary least-squares estimates will not be the 
most efficient estimates, althougKthey will be un- 
biased. The existence of such an intraclass correla- 
tlon also invalidates conventionil hypothesis testing 
based on the number of children as the number of 
degrees of freedom. Greenhouse and Geisser (Samuel 
W, Greenhouse and Seymour Geisser, "On Methods 
in the Analysis of Profile Oau Psychometrwa, 
Vol. 24, No. 2, p. 95, June, 1959) have shown that 
F tests involving the computation of "effective degrees 
of freedom" may be substituted. Their techniques 
will be used in the analysis. 



ables (TLB), the completion of pre=post be^ 
havioral and test data (T2), and the collection 
of nine months of cost data, 

TT Analysii' Groundwork for Model Effort 
The objective of T1 is the development of 
the following quantitatively-defined variables: 
center characteristic, family background, child 
and parent pre^test. T1 data include baseline 
RPIS data, parent interviews (PM1) and first 
administrations of the test battery (CT1 ) and 
child observations (C01), Analytic tasks to 
be performed with T1 data include the follow^ 
ing: 

o Construct/on of Center Characterlsa^^ ^ 

Approximately 15 center characteristics will 
be defined and constructed from baseline 
RPIS data. Variables will include several ver- 
sions of staff/child ratio, levels of caregiver 
professionalism, group size, and center or^ 
ganizational data. (Alternative definitions 
for the staff/child ratio and professionalism 
were discussed earlier In Chapter 3J Prob= 
lems of missing and biased data will be con^ 
sidered in a validity analysis of the definitions 
(cf. Chapter 5 of this volume and Chapter 4, 
Volume L) 

Center variables will be tabulated at the center 
level and used for a more detailed analysis of 
the distribution of characteristics tuNy des= 
cribing the study sample. Center and site 
^ selection methods have ensured that staff/ 
child ratio, professionalism, and group size 
are relatively independent in the sample. 
Since the number of additional independent 
dimensions in the sample is unlikely to exceed 
three or four, a final small set of interpretable 
center variables will be ditermined, including 
the policy variables, which account for most 
of the variance in center characteristics, 

Final outcome of the analyses will be a set of 
center variables accounting for a substantial 
portion of the total variance of center char^ 
acteristics and lying reasonably close to the 
centroids of corresponding clusters of center 
variables. Thus, each of the variables will be a 



surrogate for a different variable cluster and 
will approximate a '^factor/' These factors 
will then be used to classify centers by their 
values for these key variables. The resulting 
distribution will describe the experimental 
design as it is implemented. The sample's 
variation of center characteristics determines 
the statistical power available to address cen- 
ter=level policy questions. This method of 
construction of the variable set precludes 
multicolinearity in the regression. 

» Analysis of Parent In tervie w 

Parent interviews will be analyzed with three 
objectives in mind: 1 ) construction of a pro= 
file of parent attitudes, center involvement, 
background characteristics, and satisfaction 
with day care service; 2) construction of pre- 
interview variables to be compared later to 
results of the postMnterview, particularly for 
assessment of satisfaction related to center 
program variables; and 3) construction of 
background covariables for use in the quanti- 
tative model. While the first two sub-tasks 
are straightforward, the third warrants further 
discussion. , 

Coleman's data for school-age children lead us 
to expect that perhaps 25 percent of the total 
variance in outcome may be accounted for by 
properly chosen covariables. Two immediate 
candidates are mother's education and occu- 
pational status, both dimensions of SES. The 
child's previous child care history is very likely 
to yield a useful covanable, and day care atti^ 
tudes, child care attitudes, and family structure 
variables may provide further explanatory 
power. Since there are no true dependent vari- 
able data yet available, construction of covari- 
ables must begin not with consideration of 
their statistical power as predictors, but as use- 
ful variables in the child and parent data actu- 
ally collected. The profile analysis described 
above is intended to assess these properties. 
Essentiatiy exploratory, it will result in pro= 
files of age and sex of children, SES character- 
istics, children's educational history, attitudes 
and expectations, and similar factors as they 
relate to center characteristics. 



Together with simple statistics, these data 
will be inspected to eliminate data points 
which appear unreliable or which vary too 
little across the sample to be of use. 

The next procedure will be correlational and 
cluster analyses of the data. As with the 
analysis of baseline data, the objective is to 
describe the variations in the data, using as 
few variables as possible. Principal compo- 
nents and cluster analysis will both assist 
in constructing key variables capturing most 
of the total variance and representing larger 
variable clusters. These variable clusters will 
then be considered as the candidates for" 
child-level covariables in developing the 
quantitative model (the first analysis of 
their power as predictors must wait until 
T1,5 center process variables have been con- 
structed in the spring of 1976). 

• Psychometric Analysis of the T1 Test 
Battery Data 

The T1 fall test battery included the following 
instruments administered by SRIi 

— 64 Item Preschool Inventory (PSI) with 
Hertzig-Birch Scoring 

— McCarthy Verbal Memory Test (MVMT) 

— Matching Familiar Figures Test (MFF) 

— Pupil Observation Check List (POCL) 

These tests were designed to measure several 
dimensions of cognitive ability and cognitive 
style. Psychometric analysis will assess the 
validity of the data to determine their psycho- 
metric properties and to prepare several scales 
with known statistical and psychoiogical pro^ 
perties for use as variables in general study 
analyses. 

The following specific tasks will be performed; 

— Analysis of SRTs report on summer field 
tests of instruments. Coordinated decisions 
on Phase II protocols. 

— Analysis of a sample of fall protocols for 
assessment of coding quality, leading to 
systematic recoding as appropriate. 
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Compfiation and study of background ljter= 
ature on instruments including psychometric 
properties, developmental norms, psycho= 
logical constructs, 

— Comp :ation of internal reliabilities, item 
frequencies, item^total correlations, corre^ 
lations of subscores and scores among tests, 

= Computation of norms for study sample 
and analysis of variance of scores across 
centers, sites, sex, and age. 

= Assessment of validity and psychometric 
reliability of scales as outcome variables, 
with particular attention to expected nor- 
mal development of scores during the study 
span. 

Recommendations will be developed for oper- 
ational definitions of cognitive^ measures to be 
used as dependent variables. Definitions will 
require citation of relevant background litera- 
ture to support their content validity and to 
reference them to developmental data. ' In addi^ 
tion the measures must be supported by psy- 
chometric analysis internal to the study. Al- 
though NDCS data may be used for scale con- 
struction, this will not be done in such a way 
that previously obtained data are invalidated, 
or that whole new constructs are developed. 
This analysis will not be complete until T2 
data are also available so that the stability of 
the measures and their developmental proper- 
ties are known for the NDCS study population. 

• Ana/ysis of Ch/fd- Focused Observational 
Data 

Child-Focused Observational data will be coh 
iected at approximatery the same times as test 
battery data, using the SRI-Prescott instrument 
(modified substantially from an earlier form 
developed by Elizabeth Prescott). Since this 
marks the first time that direct preschool child^ 
focused observation has been used in a large= 
scale study, the potential value of data from 
this source is so great that the instrument will 
be further developed as a result of T1 analysis. 
Most development will be concentrated on 
sharpening its potential to assess the specific 



child traits discussed in Chapter 3, such as 
cooperation, dependency and assertiveness. 

Since the instrument is under development 
and still being tested and refined, it is not 
yet clear to what extent these two major 
analytic purposes can be achieved. Actual 
frequencies of events observed in the field 
and their psychometric properties are only 
now being analyzed. The#ifrt task is in 
fact an investigation of th^sfe formal analy- 
tic properties, somewhat apart from their 
psychological content. A special computer 
program has been developed to analyze the 
statistical properties of T1 SRhPrescott data. 
The individual SRI observational codes will 
first be analyzed, and when the properties 
of these codes are well known, construction 
of more complex psychological variables can 
begin. These may be discussed in terms of 
the three potential analytic purposes they 
may serve: 1) analysis of child traits, 2) 
structural analysis of tnteractions, and 3) 
analysis of specific classroom processes: 

1 ) Child traits such as dependency are address- 
ed directly by individual codes, for example, 
''seeks comfort"; however, the ability to 
reach conclusions about any pattern of 
child traits requires l^th sufficient frequen- 
cy of the trait behavior within the observa- 
tion time limit and observer reliability. 
The use of a trait variable in an analysis of 
child growth will require high measurement 
reliability and stability! This reliability 
and stability is not expected at the individual 
child level, but it is anticipated that behavior 
change aggregated to the group and/or cen^ 
ter level will be analyzable for sensitivity 
to variations in the policy variables. Defini- 
tions and pre-post analysis will be pushed 
as far as is feasible. The prime purpose 
of the work will be, however, instrument 
development rather than direct analytic 
usefulness in Phase II. 

2) The Prescott instrument data will be analyzed 
for its usefulness in assessing adult-child and 
child-child interactions. Each variable, such 
as frequency of adult^child interactions, may 
be defined straightforwardly from the observa 
tion codes, A limited analysis of time=use by 
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type of activity seerns feasibltv The more ob- 
jective content of these variables makes them 
easier to measure and to use directly in 
Phase 1 1 analysis. 

3) A third analytic purpose is to determine the 
extent to which the instrument can detect 
specific processes such as compliarico witli 
adult requests. The events which bear upon 
such a variable rnay be relatively rare and 
thus present the greatest difficulty in 
measurement, and it is probable that Tl 
data will not allow meaningfu' definitions 
of such variables. Because of their psycho^ 
logical importance, however, further instru- 
ment development is concentrating on 
sharpening the system for observing these 
events, even though preliminary results rTiay 
indicate difficulties. The payoff for this 
work will be in Phase 1 1 1 rather than Phase I L 

T1,5 Analysis^ Construction of Clasiroom Process 
Model 

Classroom process observations become avail 
able at Tl .Bousing the SRI classroom Tocus 
instrument. The objective of this phase of 
analysis is to construct classroom process vari- 
ables, analyze the observation data in terms 
of these variables, and to integrate the vari- 
ables with center program variables and back^ 
ground covariables in a preliminary analytic 
modeL The first five research questions about 
classroom process* may be tested statistically 
using the modeL 

The process model will make it possible to 
consider quantitatively the hypothesis that 
process measures are causally affected by 
center variables and the covariables. This pre^ 
liminary model must be constructed at a group 
level, since the dependent variables represent^ 
ing classroom process are measured only at 
that leveL Covariable analysis, as mentioned 
earlier, must wait for the availability of de- 
pendent measures at the child leveL 

Some of the questions to be asked include: 
How are the process measures related to the 
independent variables? Which independent 



'Questions 3.1-3.5 are Listed in Chapter 1 of this volume. 



variables seem most significant? Do relations 
appear to be linear or curvilinear? Analysis 
will begin not with mathematical estimation 
techniques but with such simple methods as 
contingency tables and graphical analysis, 

A large number of process measures may be 
considered, with development of the pro= 
cess model used to refine process measures 
and select those most sensitive to program 
variation. Approximately six to eight inde^ 
pendent variables will be invoLved, and caution 
will be exercised to avoid capitalization on 
chance, which can occur when one of the 
many possible process measures correlates 
highly, entirely by chance, with one of the 
program variables. Thus, the plausibility of 
relationship must be considered as well as 
the quantitative data. Phase III allows 
cross-validation of any suspected relation- 
ships with new data. 

When the graphical analysis is complete, 
mathematical regressions will be run be- 
tween the more sensitive process measures and 
the independent variables, using the SPSS com 
puter package. The objective here will be to 
develop a ''best" linear model relating each 
process variable to center-level independent 
variables. The policy variables ^ staff/child 
ratio, professionalism, and group size ^ will 
certainly be chosen as three of the regressors, 
with the remainder selected from three or 
four possibilities at the center level and three 
or four to be constructed from child and 
parent data. The total number of possible 
regressions is not likelyito exceed 2^, or 256, 
Virtually all of these may be examined with- 
out reliance on such techniques as step^wise 
regression, The result will be a small assort- 
ment of reasonable linear models explaining 
process. 

This analysis is important because it will focus 
attention on the components of classroom pro 
cess most sensitive to changes in the program. 
It may very well lead to improved definitions 
of classroom p' icess based in t on their 
correlations v program varic iles. Although 
there is not u . ^nre penalty in retaining a 
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number of process measures at this stage of 
the analysis, the number must be pared down 
substantially before the process measures can 
be used as predictors of final out^^ines in 
order to avoid capitalization on chance. For 
this reason, the process structure should be 
described as leanly as possible before analyses 
of change scores or other final outcomes are 
undertaken. 

T2 Analysis: Final Construction of Outcome Model 

The rnajor objective of T2 Analysis is the re^ 
finemeht of the quantitative model relating 
process measures, independent variables, co- 
variables and developmental measures, - This 
model will extend' the group level process 
model developed after Tl ,5, and, as in the 
development of that preliminary model, 
graphical analysis will be used to become 
familiar with the T2 data. This quantitative 
model of child impacts will be constructed 
after a set of final outcome variables has 
been defined, variables dependent on the 
pre- and post-testing batteries, pre- and post- 
observations of children, and administration 
of final parent interviews. The basic design 
of the model, which will incorporate child 
and parent covariables, center level program 
variables, classroom process, and final out- 
come variables, was discussed at the beginning 
of this chaptar. 

Each impnrtsnt problem area in ordinary 
multiple regression has its graphical counter- 
part and may be explored graphically, so 
that problems can be recognized early. Most 
problems are detectable through eKamlnation 
of residuals after plots have been made, and 
such graphical residual analysis will be per- 
formed as an important step of the process. 
Mathematical analysis will begin with ordin- 
ary multiple regression using the SPSS com- 
puter package. Analysis will be univariate in 
the sense that only one dependent variable 
may be considered at a time.* 



*Multivarlate techniquei simultaneously consider sever^ 
al dependent measures. Both ordinary and multivari- 
ate regressions consider several independent variables 



An integral part of the modeling process will 
be an analysis of residuals for deviations from 
normality, correlation effects, and hetero^ 
geneity of variance. Existence of any of these 
properties indicates problems with the validity 
of hypothesis testing and the statistical estima- 
tion which must be corrected by rescaling, 
adding variables or interactions, or cons'deriny 
modifications to the estimation technique. 
We are particularly concerned about the magni^ 
tude of a within^class correlation effect. Even 
after class-level effects are controlled for in ^ 
the regression, there are likely to be correla- 
tions for test scores and other dependent vari- 
ables for children in the same classes. The ef- 
fect can be caused in several ways ---'observer 
effect, class^level unreliability, improper 
modeling, and so on — and will certainly occur 
to some eKtent. Process measures m particu- 
lar involve the whole class and will yield sub- 
stantial child^to^child correlation. Using the 
child as the unit of analysis, a within-class 
correlation of as little as .05 will seriously af- 
fect the accuracy of least-squares regression 
estimators, and will affect the validity of hypo- 
thesis development and testing. CortSequently^^ 
an "effective degrees of freedom" method 
(Greenhouse and Geisser, op, citj will be em= 
ployed to correct sample statistics used in 
hypothesis tests. Note that this within^class 
correlation will not bias values for estimates 
of effects, although tjieir variance will be af- 
fected, ^ 

The product of this task will be a model that 
relates process measures, independent variables, 
covariables, and developmental measures. If 

at once. The greater povver of multivariate regression 
derives from its consideration of correlations which 
may exist among dependent variables. When strong 
correlations exist, the multivariate model yields esti- 
mates for effects which have smaller expected errors 
and narrovver confidence regions than those of the 
simpler model, vvhich is the principal argument for 
its use. Hovvever, the initial analyses vvill use ordinary 
multiple regression because it is considerably less cost- 
ly in computer time when independent variabies are 
being selected as regressors. It is unlikely that the 
slight loss of statistical power will have, much bearing 
on .the results, but this posslbMity will be routinely 
checked. 
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the potential increases In statistical power ap= 
pear to warrant it, the model will be extended 
TO full multivariate form/but quite likely im= 
mediate needs — planning the eKperimental de= 
sign of Phase III — will be well served by the 
simpler version. (Multivariate regression can= 
not save a situation which appears hopeless 
based on ordinary multiple regression analysis,) 
The resulting quantitative model of day care 
will be subjected to testing and validation and 



will summarize the information developed in 
Phase IL ^ 

The logic of the final quantitative model will 
be presented as a diagram like that of Figure 
4-2, which reflects a choice of nine variables 
and 18 separate paths by which one variable 
can influence another, The diagram is really 
a graphic representation of a set of regression 
equations. It will be conservative in the sense 



Figure 4-2 
Diagram of EKample Regression 
Relationships Among Variables 




1) 


P: 


Professionalism 


2) 


SCR: 


Staff/Child Ratio 


3) 


R/P: 


P X SCR (Interaction) 


4) 


SCF; 


Staff/Child Interaction Frequency 


5) 


SCL: 


■ Staff/Child Interaction Length 


6) 


CA1: 


Cognitive Ability (Pre) 


7) 


CA2: 


Cognitive Ability (Post) 


8) 


CS: 


Cognitive Style ,' 


9) 


SC: 


Social Competency / 



information on the statistical power of the 
tests of significance, but Table 4^2 indicates 
a format for this presentation. Statistical 
power is a function both of the.true size of 
the effect we wish to detect and of the level 
used in the significance test (discussed in Chap- 
ter 5K* Usefulness of these power tables in 
planning Phase III will be discussed in Chapter 
''Framework for Phase III Planning/' 



*lt should be noted that the Phase 1 1 model will not 
exclude potentially important relationships even 
though they have not been proven. significant on the 
basis of statistical power. Such relatlonshipB* even 
though significant only at ,25, may well play an im- 
portant role in planning Phase III. 
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of Variable J 
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Significance 


of Coefficient 
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* 
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.1 
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,09 
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.48 
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.001 
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.29 
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.06 
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.15 


6=7 


.001 


.31 


6=8 


. .02 


.18- ' 




.03 


,15 . 


•Figures are for purposes of illustration only. 
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that no reasonable potential effect will be ig= 
nored and many unimportant effects are like- 
ly to be included so that potentially significant 
effects can be taken into account in planning 
Phase ML 

Estimates for each relation will be presented 
as regression coefficients, together with the 
significance level associated with the related 
statistical test. A simple form of presentation 
is indicated in Table 4-1* (While more com- 
plicated tests or partial tests will occasion- 
ally be made to test more complex hypotheses, 
results will be reserved for more technical re- 
ports rather than for those for general con- 
surnption. Table 4-1 is not directly usable fo^ 
Phase 1 1 1 planning because it does not contain 





Table 4-2 
, Power Function Tables 

(Shell) = ' 
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1 True Size of 
/ Coefficient 


i 

Statiiticil Power ^ ^ 
at Three Levels 
of Significance 
At .05 At .10 , At .15 


01 


'S 


.05 


.* 


.10 




.15 


> 


.20 





Analyiti of Day Care Costs 

Cost analysis will accomplish three specific 
research objectives. Although there may. be 
some replication of tfie research in Phase III, 
definitive answers should be developed in 
Phase II to the following questions: 

• Which regulatablo day care oharacteristics 
affect the cost of care? 

• How shouid^these uhafticteristici, which 
IncluJ'^ staff/child ratio, professionalism 
and group si^e, he defined and calculated? 

• What is the cost nf day care and how 
does it depend l \ particular combina^ 
tlons of cost dettti ininants such as the " 
staff/child ratio and profe;ssionalism? 

Definitions for progrnm characteristics such 
as staff/child ratio must bu tiie same as those 
used in assessing child outcomus so that cost- 
offuctivunoiB aniilysis ciin bo underUikon at 
the end of Phnst} III. 

Iduntifying thn mnjur doturmiruuits of day 
care costs will primnrily involvo dovulupmunt 



of an econometric model of expend itu res 
from the financial records of day care cen% 
ters. Various parts of this methodology have 
been used in previous studies of the cost of 
child development programs.* The econo« 
metric model consists of a set of Interconnect- 
ed equations, each showing the relationship 
between an Important cost variible, whose 
behavior Is to be explained by the model, and 
a set of explanatory variables, Some of the 
equations represent tautological accounting 
relationships (e,g,, total operating expense/ 
eciuals the sum of Its various components); 
others will be statistically estimated predic- 
tive equations (e,g,, an equation explaining 
the cost of food provided by day care centers 
in terms of enrollment, number of meals and 
snacks served on an average day, and an index 
of the local cost of food). 



•Cral(j Coolon, "Cost EffoGtivormis Analysfi/' Intorim 
Roport V, National Homo Stm Evaluatloth Aht AsiO' 
clatos Inc., Oetobor 1074 nnfl Dnnnlfl Oollvif?, f5fA 
tmwd Cost of thi} Fvdmit Day Caro fh/qfilnmwnts, 
Innor City Fuiui, July 1072. 



3? 



I 



41 



The model will provide a framework within 
which the cost implications of policy decisions 
can be evaluated. Among the ixplanatory 
variables in the model will be the important 
policy variables — staff/chLld ratio/ earegiver 
profesiionalism, and group size ^ as well as 
the number of federally-subsidized children , 
and the amount paid per child, Also among 
the explanatory variables will be such exo- 
genous factors as local prices for labor and 
other input, local population density, local 
demand for care, and the legal organization 
of the center. Among the variables whose be- 
havior the model will explain will be cost of 
care per child, fees charged to private-pay ^ 
clients, and th^ centers' net earnings. Once 
the model has ^een speciffed and the para- 
meters in the stochastic equations estimated, 
It will be possible to simulate the effects of 
independent variables on the dependent eco- 
nomic variables. Simulations can be perform- 
ed for alternate sets of values for the exogen- 
out variablei to identify differentials In the 
cos t^T^!p 1 1 ca t i 0 n s of policy yeclsions from one 
set of local circumstances to another and for 
different types of centers. . V ^ 

During Phase II, the forecast/simulation' model 
will be used to identify the policy variable^' 
which, when allowed to fluctuate ovfir a rele- 
vant range, have the greatest effect on the 
cost of center-based cjay care in nnetrppolltah 
aftas. Published data a^d information from 
the National Day Care Supply Study's tele- 
phone survey will be used to determine the 
relative weight given to local demand for care, 
input prices and to different types of centers 
in aggregating effects to form national forecasts. 

Important to Phase II research will be a care- 
ful study of the effect of changes In staff pro- 
fessionalism on the cost of the caregiver's 
time. A number of recent aconomic studies 
of the determinants of intraoccupatlonal wage 
differentials provide theoretical and empirical 
background* The most widely used model 
explains the salary paid by the firm (day care 
conter) for a particular typo of worker In 
terms of wages In competing occupations 
(socrotary, oldo In public schools, otc), an 



indicator of the importance of the particular 
occupation (percentage of local labor force 
in the occupation), and a set of quality vari- 
ables. In the case of day care center staff, 
quality.variables will include years of previous 
child care experience, general educational at- 
tainment, and the number of special courses 
completed. 

Timing of these tasks during Phase 1 1 depends 
on data flow from the research sites. The 
first important analysis task will be an examina 
tion of the relationship between the wage rates 
paid to caregivers and their qualifications (ex- 
perience and educational attainment). Data on 
salary scales and on qualifications from staff 
backgroLJnd questionnaires will be available 
early enough that statistical analysis can be- 
gin during J^nuaryJ975, with results to be 
'presented in iMerim Report III. 

The second major^alysis task will Involve de- 
termination of the relationship between staff/ 
child ratios and the cost of day care per child. 

^ A mixed statistical/accouHjlng model of cen- 
t^ expenditures will be dev^oped for this 
purpose. The data nece^ary t^construct this 
model will arrive from partlcipatHig centers 

. on a monthly basis, but with a repb/ting lag, 
(Data for the month of October, for sxarnple, 
may not be complete and available for analy- 
sis until spring of 1976,) The preliminarK 
version of the expenditure/cost model will \ 
have to be available for Phase III planning by\ 
the beginning of May 1976, On the basis of 
the expected lag In data availability, the model 
must be developed with f Ive^month data from 
October 1, 1975 to February 29, 1976. 

A second version of the expenditure/cost 
model will be available for the Final Phase II 
Report in early September 1976 based on 
eight^month data which (unlike the five-month 
data referred to above) has been converted 
from a cash recording system to an accriial 
recording system,* 

*This adiustmont smooths out laruu ono'timu^pur ynar 
oNpomlltiiroi (Q,g,, InsuranQo promlutns or toxas) ovor 
n 12«rnontfi purlod, Without this atljustmofit, cliiui on 
oKpanditurfm inuy ovuf iliilii or undurstutu thu coit of 
oporatlons clurlny u part of thu yuar, 
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Chapter 5^ TESTING AND VALIDATION 
OF PHASE H COfyCLUSIONS 

Quantitative results of the study will be sub^ 
jected to a technical eKamination of their use- 
fulness. Because the results of Phase II will be 
used principally to design Phase III, validity 
assessment will concentrate on potential effects 
on Phase III design. Nevertheless, potential 
problems in external validity must be detected 
early enough to allow appropriate changes in 
the Phase III design. Overall assessment areas 
include the following: 

• Significance and Power Analysis 

• Site Effects and Generalizability 

• Analytic Bias 

— Attrition 

— Self-Selection 

— Anajytic Methods ' 

Measurement 
Simultaneous Equations 

SIGNIFICANCi AND POVVER ANALYSIS 

The quantitative models under coniideratioh 
will have been subjected to a great deal of sig- 
nificance testing during their development, a 
familiar part of the analytic process. In this 
case, however, the models will be subjected to 
a further roUnd of significance testing com- 
bined with power analysis to provide more 
information about the internal usefulness of 
the findings for planning Phase ML While a 
researcher might be extremely reluctant to 
publish a finding statistically signlficnnt at the 
.25 level, it would be irresponsible to ignore 
Its potential use in the Phase III design, Be- 
cause the concept of power is not a familiar 
one, this section will e\plain the application 
of power theory to the NDCS* 

If the Independent variables do affect out^ 
cocnes, how likely Is the National Day Care 
Study to detect these effects? This depends 
on the si^e of those effects, nnd th^ study 
will do much bettor at dotoctino largo offpcts 
than smiill ones. The theory of itatiitlcal 
powi^r tr^cicits this problem directly, mciking it 
. possiblojto assusB, for a given oxporimontal 



desigrt/.the probability of detecting effects 
of specifredsizes. This probability is expressed 
as the poweMunction. IdesHy, the power 
function would equal one whenever there is 
actually an effect, and^^ero otherwise, and 
would correspond to an>xperirnent which 
would always produce the cbrrect results. 
If the null hypothesis were cor^ict, the experi- 
ment would say so. If not, the fexperJment 
would detect the deviation and Nject ih^ hypo- 
thesis. 

It is regrettable that statistic H pbwer is such 
a complicated technical issue, because it is 
extremely important to this project. Before 
data collection, we can assess quantitatively 
what we intuitively think of as a;power of 
the experimental design. After diata are col- 
lected and analyzed, some relations will be 
labeled as sign/f/cant — at some li vel — and 
others will be labeled as not provun significant. 
These latter cases, where the null hypothesis 
is not disproved, may arise either because no 
effect exists or because the powerj of the test 
. was not sufficient to detect the effect. 

1 

We cannot discard variables from Ihe Phase III 
design simply because they are not proven 
significant at some level. Significance tests are 
usually very conservative, and effects which 
are practically significant may fail the signifi- 
cance test through pure chance. The theory of 
power deals with the probability of detecting 
statistical significance, given the truth of an 
alternative hypothesis, 

Normally, the probability of detecting alterna- 
tives which are quite similar to the null hypo- 
thesis is very low. Thus, for example, we 
might find that the probability of detecting a 
small effect was .1, but for a larger effect, the 
probability was ,5. For practical purpoies. If 
an independont variable produces a very small 
effect, wo may be willing to consider this no 
effect at alL If, for example, the PSI scores 
change by only two points we may feel that 
this is too small an effect to be operationally 
meaningful, Thus, if the probability of detoct- 
Iny this effect was only .1, it would not bo of 
concern. The power noocl only ho high for uT 
fucts which we have clntnrminod (ire importnnt, 
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The analysis to be presented follows that of 
Jacob Cohen in his book Statistfca/ Power 
Analysis for the Behavioral Sclencm, Rather 
than a pure regr^sion model, Cohen uies 
ANOVA and ANCOVA as model analy^s. 
This represents a simplification which will 
not change basic conclusions. The true size . 
of the effect is measured by Cohen's "effect 
size index''J_, which js calculated as a m/o 
where a m is the stapdard deviation of means 
across treatments and a represents the within- 
treatment standard deviations, Engineers 
might refer to^ as the signaUto-noise ratio. 
Multiple r2 is related to^ by the formula 









.01 


.25 


.06 


.40 


.14 



For the purposes of this discussion, effects 
have been classified as small, medium, and 
large, These definitions relate tol and r2 
as follows I 



Small 
Medium 
Large 

rhe definitions of these quantities mak# sense, 
sin^ in psychology and related fields, effects 
witlvQ^ of .2 or more are rare and effects with 

are uninteresting (in these terms, 
Goleman^ffects would be classified as medium 
to large). Inscenter-based day care, background 
variables of cnHdron and families are likely to 
have large effectVand center program variables 
smalhto-medium erfpcti. 



Assume for the momen\that there are no 
background covariibles available and that an 
analysis of the main effects toj the three de- 
fining variables can be carried 6yt by means 
of an ANOVA. There are two cdrrimon 
choices for the significance level foKtesting 
the null hypothesei, 5 percent and ib'per* 
cent. Statistical power will be estlmatedJor 
both choices, For 64 observations, the proba- 
bility cif detecting Bmall, medium, and large \^ 
effects Is as follows; 




5% Lev# 
10% Level 



.50 
.63 



.88 
.93 



This table illustrates one of the major com- 
promises in statistical analysis. The more strin- 
gent the sfgnificanice level, the poorer the 
power. Thus; at 5 percent there is only a 12 
percent chance of detecting a small effect, 
whereas at the 10 percent level, there is a 20 
percent chance. In boip cases, however, the 
power of detecting smal^ effects is meager. 
For medium-sized effects the power increases, 
quite substantiallv, and for large effects, the 
chance of detecting these effects Is about 90 
percent. In both cases, the chances are better 
than 50 percent of detectmg an effect. The 
greatest gain In power between the two sig- 
nificance levels is for medium-sized jffects. 



Power increases with sample size. For example, 
an analysis of 128 classrooms would result in 
the following probabilities that effects would 
be detected. Increases in power are especially 
substantial for medium effects. Large effects 
are almost certain to be observed. 



5% Level 
10% Level 



Smal 
.31 



Medium 
.81 

m 



,99+ 
.99+ 



This suggests that the povver of Phase 1 1 de- 
sign is not sufficient to make detection of 
small effects highly probable, while medium 
or large effects are likely to surface, When a 
small effect Is considered to be large enough to 
be of potential importance to policy, an ex- 
tremely conservative attitude should be adopt- 
ed toward "null findings/' where effects do 
not appear significant at the ,05 or , lb leveL 
Phase II has sufficient power for efficient de» 
sign of Phase ML 

Gains In power can be achieved by using back- 
ground Information on the children. 
Child-level data, Including both background 
information and testing results such as PSI 
scores, can bo used In the regression flnalysis, 
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The amount of gain in power achieved by 
using the rnvnriables depends on the correla- 
tiun coefficient X , which relates the covari- 
able to the deperident outcome variables. 
Table 5-1 exhibits the effects of covariation 
resulting in values forx of .3, J, and .7. In 
the case of the Coleman data, about 25 per- 
cent of total variance in achievement scores 
could be accounted for^y such background 
and attitudinal variables, 

If these results are replicated here, anx of .5 
might be expected. Comparison of the charts 
shows that the use of covariables would in- 
crease the probability of observing a null ef- 
fect from .30 to ,38, assuming a 10 percent 



significance level and a sample size of 128, 
This increase, which was very conservatively 
estimated, is far from dramatic but is large 
enough to justify the use of covariables. ' 



SITE EFFiCTS AND GENERALIZABILITY 

Generalizability is relevant in Phase II only as 
itrelates to the proper design of Phase III, 
since NDCS fesearch was not intsnded to ^ 
answer the major policy questions until the 
conclusion of Phase III. Generalization con- 
sists of extending conclusions based on the 
study domain of sites, centers, and indepen- 
dent variables to a larger domain of interest, 
in this case all American cities and eligible 



r- .3 
r- .5 
r - J 



Table 5 1 
Probability of Effect Detection 





5% significance 


eve! (n « 64) 




Coefficient 


Small 


Medium 


Large 


r= .3 


.13 


.55 


.91 


r = .5 . 


.16 


.64 


.95 


r' .7 


.20 


.80 


.99+ 




10% b tnif icance 


level (n = 64) 






Small 


Medium 


Large 



.22 
.26 
.31 



.68 
.lb 
.88 



10% signiflcanco lovol (n - 128) 



.95 
.97 
.99+ 





Small 


Medium 


Lnrgc 


r« .3 


.33 


.9 


.99+ 


r - .5 


.38 ■ 


.93 


.991 


1 - .7 


.49 


.99 


.99f 



4.) 



centerb and a wide range of regulatable pro- 
gram variables. The NDCS domain consists 
of three study sites and 64 study centers ex= 
hibiting a wide range of independent vari- 
ables (cf. Volume I, Appendix A; ''Sitt. and 
Center Selection''). 

The chain through which findings are to be 
generalized Is a complex one, depending on 
internal validity of the analysis and the re- 
lationships among study units and the units 
they represent in the external world. The 
establishment of internal validity has been 
treated in several sections of this report; 
the discussion that follows is on potential 
"site effects/' an issue extremely important 
to geographical generalizability. 

A site effect is a measurable difference in day 
care process or outcomes attributable to under- 
lying differences among the sites and detect- 
able as heterogeneity of regressions among 
sites. The existence of a real site effect, sug- 
gesting significant local differences in appro- 
priate day care program characteristics, would 
call into question the advisability of uniform 
day care regulations imposed on every geo- 
graphical region. A site effect is also of im- ^ 
portance analytically as a factor which may 
complicate estimation of center program 
effects. 

Phase II statistical data will not be sufficiently 
powerful to allow attribution of site effects ^ 
to particular socioeconomic variables such as 
city size. Since there are only three sites In 
the study, potential explanatory variables are 
highly confounded. Every effort is being 
made to catalog potential contributors to 
site effects during Phase 1 1 for more detailed 
study in Phase IIL 

During Phase II site identifiers will be employ^ 
ed in statistical analyses. When all interactions 
are considered, this approach is equivalent to 
making soparato regressions In throe sites, 
The question, 'Ms th^fp a site offoct?" can bo 
rof)hrasod as, "Are thci regressions tliusame?" 
Two principal kinds of site cffocts may bo 
obsorvod, with quite cliffnrunt implications, 




Consider the problem as one in analysis of 
heterogeneity of regression. Using three separ- 
ate regressions, the models 

Yj ^ttj + ^i ^2 + ®i 
Yj-aa + Xi B3 + 6; 

are fitted to the data from the three sites. If 
the tt's are significantly different site-to-site, 
then the dependent variable Y is different in 
the thi'ee sites even in the absence of the ef- 
fects of center program. For instance, average 
PSI change scores may differ significantly 
from site to site, Independently of program 
variations within site. These site effects are 
not policy relevant because they do not im- 
ply that the policy variables have different 
responses to programs among the sites, but 
simply that avferage developmental rates may 
differ among sites. 

The more important form of site effect may 
be recognized as significant differences in the 
B's. For instance, variations in staff/child 
ratio might interact with the site variable, so 
that overall effects of the staff/child ratio 
differ from site to site. Separate analyses at 
different sites would result In different con- 
clusions, and regression surfaces would have 
different slopes. If the slopes are significantly 
different, we have heterogeneity of regression, 
Tests for-heterogeneity may involve one, 
several, or alLregression parameters. The most 
interesting test might involve only one 
weight corresponding to the effect of staff/ 
child ratio, But any of the possible ways in 
which the regressions can differ may be tested 
by the routine F-test for equality of sets of 
coefficionts from site to site, The tost statistic 
may also be used to construct u confldunco in- 
terval around estlmatos of differences among 
coofficiants, 

Since the twst for a policy relevant sito offoct 
(lopunds Ofi stntistical compnrison of difforonl 
rogrossions, a significant offect Ccin oxist only 
if signlflcnfU ruarossions oxint, If Pluiso II 



should lack the power to dimonstrate effects 
of staff/child ratio and of proftsionalism, 
there is no way that significant site differencis 
in these effects can be demonstrated. Demon^ 
stration of a significant site effect requires 
substantially more statistical power than de- 
monstration of a policy variable effect, and 
tests for the site effect may fail because no 
effect exists or because of insufficient power. 

Tests for site effect do not explore^potential 
causes for the effect but merely its existence 
or nonexistence. While aT'true^ sitreffect " 
may be caused by differences among the sites, 
independent of center characteristics, a 
"false" site effect may result from confound- 
ing of center characteristics with site. We 
know that such confounding exists. For in- 
stance: 

• Education level of caregivers (and of the 
- general population) is higher in Seattle 

than in Atlanta or Detroit. 

• Demographic characteristics for the 
children are different among the three 
sites, 

• Ecoriomic class mlxmg is more common 
in Seattle and Detroit than in Atlanta. 

• Patterris of sponsorship are different 
among the three sites. 

Any one of these differences may cause an ef- 
fect which might be mistaken as a true site 
effect, While these variables may be '*partialled 
out/' the fact that they are confounded with 
site means that a true site effect rnlght be re- 
moved as well. It may not be possible to dis» 
tinguish among these and true site effects un- 
less we see strong viriations of outcome wlth-^ 
in, as well as across, sites. 

The number of different tests for site effects 
is the same as the number of different ways 
that heterogeneity of regression may be test- 
ed. Ennh test is constructed as an F test for 
coefficients of dummy variables representing 
identity. Table 5-2 enumerates these tests ' 
for a slnfllo Independont variable; l^or sevoral 









Table 5-2 






Site Effect Null Hypotheses 






For Rigression Coefficients 
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Bi = 82 = B3 
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= ^3 




Bi * Bj = B3 






■«3 


Bi 




= 32 = 


= «3 


^ B3 




= 32 = 


^3 


^ B2 ^ B3 



different independent variables, many more 
combination tests are possible including the 
well-known Chow test.* The ability to gener- 
alize to other cities is illuminated by results 
of such hypothesis testing, but such results 
should be understood In the context of statis- 
tical power. 

Consider the Implications of various findings. 
Suppose that B^ (Atlanta) ^ (Detroit) at 
a significance level of .10, demonstrating a 
probably site effect. In that case, one would 
be precluded frorri generalizing B^ or Bg to 
all cities but might be tempted to generalize 
B^ to the southern clusterand Bj to the 
northern, Since only one case is available per 
cluster, this genoralization cannot be Justified. 



^ "G.C* Chow, "Tosis of Equality botwoon Scits of Co^ 
ufficluius In Two LlnucJi Hf^^rimlom/* Baununwtr/au, 
Vol. 28, July 1060. 
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If the effects of the socioeconomic variables 
were estimable across the study sites, this 
knowledge might be used to construct esti- 
mates of the variance within clusters. One 
would assume that variance was due to these 
effects and would use the results of site vari- 
able regression. Since the= previous section 
showed that these effects were not estimable, 
within-cluster variance may not be estimated 
in this manner. 

On the other hand, suppose that = B2 with 
considerable statistical power. In this case, 
there is evidence that the site-to-site variances 
of effects are small. Since the two sites, say 
Atlanta and Detroit, were selected in order to 
highlight socioeconomic differences, the evi- 
dence is stronger than it would be were the 
two cities socioeconomically similar, although 
it is difficult to make this a quantitative argu^ 
ment. If " B2 * B3, the evidence is stronger 
still, and the generalization that B's are nearly 
equal for all sites is reasonable, particularly 
when there are other independent data to sup- 
port the conclusion. 

Generalizability, then, is supported when null 
hypotheses involving the quality of certain re- 
gression coefficients are not rejected. The 
strength of the evidence on generalizabllity 
depends directly on the statistical power of 
the tests used, power that can be estimated 
using the tables pre^ted earlier and follow- 
ing the same conventions regarding small, 
medium, and large effects. If the effect of a 
program variable is small, there would be little 
interest In adjusting it ffom site to site, because 
the site effect would be of little Importance In 
a Phase III design. If an effect is medium, then 
small site effects would be of interest; if the 
effect is large, thtin medium site effects would 
require explicit consideration in Phase II h 

Thus, we may construct the following con- 
tingencies, based upon 125 degrees of free= 
dom (there are 126 target classrooms in the 
NDCS as of this writing), as in a group level 
tinalysis, Each statoment relates the outcome 
of statistical effects tost to the real situation, 
If the pronram uffoct is smalTin sl^jMn prob^ 



ability of detecting it at a significance level of 
.10 is about .30, and detection of a site effect 
is very unlikely. If the program effect is 
medium in size, there is about a =9 chance of 
detecting it and a .3 chance of detecting small 
site effects* If the program effect is large in 
size, it is practically certain to be statistically 
significant, and there is a ,9 chance that a 
medium site effect will also be significant. 
While these statements are made as though 
we knew independently how large the pro- 
gram effect is, in reality we will see only the . ^ 
results of the statistical test and will have to 
infer the size of the program effect. 

Using the information in the preceding para- 
graph we can examine the situation from the 
point of view of reasonable inferences. If 
statistical tests do not indicate a program ef- 
fect, then it is relatively certain that the real 
effect is at least small, and Phase 1 1 1 may be 
designed without great concern for a site ef- 
fect. The results, if replicated, would indi- 
cate that a substantial effect is unlikely to 
exist anywhere. If a significantly large pro- 
gram effect is detected, but a significant site 
effect is not detected, reasonable generaliz- 
ability to other cities would also be expected. 
If a medium site effect were detected, on the 
other hand, generalizability would be threat- 
ened and Phase 1 1 1 should be designed with 
the supposition that a site effect exists. 

The most ambiguous results are obtained when 
a medium program effect is observed. If a site 
effect is detected, then it is probably real and 
should be considered. If a site effect is not 
detected, however, It is not disproved because 
of ioM\/ statistical power* The direction that 
Phase in design should take would require 
assessment of additional information. 

ANALYTIC BIASES 

Severn/ forms of statistical bias ore likely to bo 
confronted during the course of tlie National 
Day CaTo Study. This section dofinos tlin 
nature and consequences of bias, identifies the 
circumstancos which may give rise to it, and 
sufjgests sornu rumodial actions. 



Bias is, the divergence between tljie true value 
of a parameter and the expected value for a 
particular estimation formula and a particular 
sampling procedure. If 0 is used to denote the 
true value of the parameter and E (0) is used 
to symbolize the expected value iDbtained 
from a particular estimation method, then 
bias is defined as: 6 (fl) - 0. Biased estima- 
^ tion methods may yield unreliable numerical 
estimates and tend to distort the results of 
hypothesis tests, Some bias may De accept- 
able if the estimator is consistent, so that bias 
becomes very small for large samp les, but in- 
consistent estimators are nearly alyvays trouble- 
some, 

Four potential sources of bias will be consider- 
ed explicitly in the Phase II analyses. Attrition 
bias and se/f-se/ection bias are possible conse- 
quences of the composition of the research 
sample, i\/Jeasurement bias Bnd simultaneous- 
equations bias may result from our choice of 
estimation method. 

Attrition is the loss of children in the study, 
especially of children for T2 testing and obser- 
vation, who were present at T1. They may 
have dropped out of the study, may refuse 
participation, or may be absent on the testing 
date, if the excluded children are different 
from retained children in some substantial 
systematic way, the analysis that depends on 
pre-post data will exclude these children and 
will be based on a biased sample. Self selec- 
tion occurs when the selection process is not 
random but depends on the willingness of 
the subject. Since willingness may depend 
on the characteristics of the subject, the 
sample may be distorted and analysis affected. 

The approach of the study to attrition bias 
and self-selection bias should be sequential, a 
primary task being to measure the degree to 
which attrition and self selection have occurred, 
If the occurrence' is large (more than 5 percent 
of the sample) or concentrated In one or a 
few centers or In certain typos of centers, the 
next step should be a comparison .of the char- 
acterlstics of the subjects remaining in the 
sample with the characteristics of those who 



declined to participate inftially or who have 
since dropped out. 

Note that not every difference between the 
two groups is necessarily a source of bias. The 
difference must be such that efforts to esti- 
mate relationships between outcomes and pre- 
dictive factors is distorted by the composition 
of the remaining sample. If the group made 
up of those who declined to participate initi- 
• ally or who thereafter dropped out is large 
and in any systematic way different from the 
group of remaining subjects, the Office of 
Child Development will be advised, and a 
joint decision will be made on adjusting the 
Phase III design to eliminate possible distor- 
tion of statistical results. 

Measurement bias will arise during Phase II 
whenever the data used for explanatory vari- 
ables in regression equations are contamin- 
ated by measurement error. One source of 
measurement bias Is the use of pre-test scores 
in regression equations to explain post-test 
scores. The pre-test instrument Is of less 
than perfect reliability, so the figure entered 
in the regrraion does not equal the true 
score. Tfris may be shown to bias the esti- 
mate of the regression of the post-test 
score or the pre-test by p factor equal to the 
test-retest reliability. This factor, if It is 
known from othfer data, may b^-ysed=4D__ 
remove the bias. 

The bias Just deicribed occurs even when the 
error in measuring the pre-test score is un- 
correlated with the true pre-test score, and 
the situation Is even worse when these corela- 
tlons exist. But there is a corrective approach 
in this case, even when better data cannot be 
obtained. The remedy is to correct the stan- 
dard estimation formula for multiple regres- 
sion to reduce the sensitlvlty-to-measurement. 
error. An estimation technique known as the 
Instrumental variable (IV) method* provides 
such a correction, The (IV) method is a two- 



*Tho IV MothncJ U djicussed fully In Cfiaptor 9: 
Henry Thril, Principlvs of Ecunoimtrics, Wiloy & 
Sons, Now York, 1971 
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stage technique. In ttie first stage, the variable 
subject to measuremtnt error is regresied on 
a set of known correlated variables derived 
from other Instruments. For example, MVMT 
scores, MFFT error rate, Parent Interview 
(child/family demographies)^ data might be re- 
gressed against PSI pre-test scores. A set of 
predicted values are generated from this first- 
stage regression and used as data for the mis- 
measured variable in the originally-posited re- , 
gression relationship. The (IV) estimator is 
biased but consistent (the bias decreases as 
the sample size Increases), whereas the ordinary 
regression estimator is biased and inconsistent 
"as well. 

Simultaneous BquQtions d/a^arlseswhenthe 
connection between two variables in a regres- 
sion analysis occurs in both direGtlons simul- 
taneously. Such interactions are most likely 
to arise during Phase II in the estirnation of 
relationships in the cost model. For example, 
one equation in the cost model would explain 
the average wage paid to caregivers in a given 



day care center in terms of the professional 
qualifications held by caregivers in that cen-' 
ter. Whether or not it is recognized explicit- 
ly in the cost model, there is clearly another 
relationship at work by which the professional 
qualifications of caregiveri the center has 
been able tp obtain is influenced by the wage 
rate the center pays. In effect, professional 
qualifications and wage rates are simultaneous- 
ly (jointly) determined; the caulation between 
them goes both ways. This joint causality can 
be shown to introduce bias into statistical 
results W'hen the uncorrected regression for- 
mula is used for estimation. Since the rela- 
tionship between cost and professionalism 
is a critical issue in the National Day Care 
Study, this bias must be reduced. The instru- 
mental variable method described above for 
measurement bias can also be applied to the 
simultaneous equations problem. Again, the 
' IV method will not eliminate the bias com- 
pletely but should significantly reduce it , 
for the sample slies we will have available. 
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Chipter 6: A FRAMiWORK FOR PHASE III 
PLANNING 



The Phase III disign will be based on a com- 
bination of policy requirements and feasibility, 
as determined during Phase IL The approach 
to the development of the design is based on 
a systematic application of Phase 11 information, 
much as Phase I field and lurvey data ware 
used to select Phase I I sites and centers. The 
Phase III plan will be developed by a sequential 
set of decisions based on these data as described 
in this chapter, and the plan will be continually 
revised if new information or criteria warrant 
changes. This chapter briefly discuss^ the 
framework within which decision rules and 
actual Phase III decisions will be made during 
{he spring of 1976. 

The d^ign for Phase 1 1 1 will include thrae com- 
ponents: 

• I nstru ment selection 

• Development of basic experimental de- 
sign 

• Selection of sites, centers, experimental 
manipulations 

• Plan for experimental manipulations 

This chapter assumes that several steps of 
Phase II research have been completed and 
the results are available: 

• A list will have been developed of the 
Independent variables that might be 
experimentally manipulated during 
Phase 1 1 1 of the study. Since only a 
few variables can actually be manipu- 
lated, this list will consist of a subset 
of the variables presented In Table 6-1. 
Staff/child ratio and at least one com- 
ponent of professionalism (educational 
attainment, previous experience, etc.) 
are certain to be chosen as design vari- 
ables» 

• An analysis relating procesi variables 
to independent variables will have been 
completed according to plans presented 
earlier In this volunrie. This analysis is 
to be completed In the T1.5 analytic 
period. 
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Table 6^1 
Partial List of 
Independent Variables 

• Center Variables {Programmatic) 
Ratio 

Group Size 
Genter Size 
Age Mixing 
Auspices, Funding 
Age of Center 
Services 

Educational Program 

• Center Variables (Staff) ^ 

Education 

Professionalism 

Experience 

Staff Age/ Rate/Sex 
Staff Turnover 

•J 

• Family Variables x 
Child Age/Sex/ Race 

Family Income 

Family Attitudes/Expectations 
Family Structure 

Chlld*s Previous Day Care Experience 



• An analysis involving both T1 and T2 
scores will be available In time for final 
selection of Phase III measures, but not 
in time for selection of sites, centers, and 
a basic design. 

The Phase III basic design will include the 
following components, each of which must 
be resolved: 

• Choice of variables (1) to be experiment- 
ally manipulated and analysed as pre- 
dictors of outcome, (2) to bo monitored 



Phase II sties, Phase. II has been designed to 
make possible such a decrease in study units 
by an analytic narrowing on the basis of 
Phase M results. We will also consider retain- 
ing more thnn 32 centers if a larger nunnber 
would increase the power of study findings, . 

The followiog table presents four basic options 
in distributing approximately 32 study centers 
in one, two and three sites. The table is meant 
to depict broad options, not small details, so 
^that, forexamp e, option III might actually 
Involve a 10/10/10 center distribution. 

Exact numbers to be selected in each site de- 
pend on the exact number in a desired experi- 
mental replicate (identical experimental blocks) 
and the exact total number of study centers. 
Options with fewer than eight centers in one 
or more sites cannot be considered because 
they reduce experimental blocks to unaccept- 
ably small sizes. The first three options afford 
equal representation of centers in one', two, or 









Table 6-2 
Alternative Site Dqsigns 








Site 
Design 
Options 


' Number 
of 
Sltsi 


FraQtlonil 
Distribution 
of Centsrs 


EKemple 
Atlenta 


Center Distributidh * 
Detroit Saettle 




1 


1 1 


All in Atlanta 


32 


F 




II 


2 


One-half in each of 
two sites to be 
selected 


16 


16 




ll'l 


3 


One-third, one-third, 
one-third in each of 
present three sites 


12 


12 12 




IV 


3 


One-half in Atlanta, 
one-fourth in Seattle, 
one-fourth in Detroit, 
proportional to present 
distribution 


16 


8 8 



at constant values to the extent possible, 
(3) that nnay be allowed to vary, possibly 
confounded with other variables. 

' * Selection of a factorial design for basic 
replication, including choice of experi^ 
mental levels and feasible experimental 
manipulations. 

• Choice of site or sites and of replication ■. 
patterns within and across sites. 

These three design components are not inde- 
pendent and the choices available are jointly 
constrained by the parameters of present 
Phase II design and by the actual opportunities 
available for controls and manipulations. For 
this reason, the basic alternatives should be 
presented before the details of specific deci- 
sion mechanisms are examined. 

The RFP as well as previous proposals and 
reports agree that about 32 of the present 64 
centers will be retained in one or more of the 
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.three sftes, while the last retains the propor^ 
tions of the Phase II distribution, Thus, the 
third option may suggest three 3x2x2 repli- 
cates, for a total of 36 centers, while the 
fourth would suggest retention of four 
2 K 2 X 2 replicates and 32 centers, but either . 
might be changed to fit a different factorial 
design. 

The question of the feasibility and practicality 
of multi-level designs needs to be reviewed. 
. The intent of the- RFP was that staff /child 
ratio and professionalism, and perhaps other 
variables, should be set and maintained at 
discrete fixed levels, and that the basic analy- 
sis should be performed as ApsToVA or 
ANCOVA. It will be necessary to deviate 
somewhat, bflt not substantially, from this 
plan for the fpllowing'reasons: * 

f New levels of the variables, t^e staff /child 
ratio for instance, may not be set to fixed 
levels such as 1/5 or 1/15 very exactly 
without great expense and substant'nt 
intrusion. The manipulated variable:, 
will depend on accidents in the original 
circumstance as well as the manipulation. 
The extent of center reorganization should 
be minimized. 

• Even if ratios were set to specified values, 
attrition or addition of teachers and 
children would change these values 
throughout Phas^ III. Observations 
taken to date show large fluctuations, 

in enrollment. We will try to exercise 
control but such control cannot be per- 
- feet. ' ^\ 

• Actual operating ratios also vary substan- 
tially throughout the day during different 
activity periods and as a resu-lj of different 
schedules of caregivers and children. 

Since true fixed-level designs are not feasible, 
ordinary ANOVA or ANCPjVA Is not a feasible 
means of analysis. The variability of Irnlepen- . 
dent variables demands use of multiple regrp^ ^ 
slon models of the types discussed earlieri How- 
ever, statistical power Is much enhanced by en- 
suring that variables have considerable variance 



and are nearly independent of each other. Ap- 
proximate implementation of a factorial de^ 
sign will lead to an efficient experimental de- » 
sign, even though it will not be analyzable by 
simiDle ANCOVA. . 

Since implementation of even a two-leveHac* 
torial design will be very imperfect, and quan- / 
tities can be expected to vary Qver the course / 
of Phase III, it is not necessary or desirable 
to consider more than three levels for any 
variable. The principal reason that multi-level 
designs are u^d by ANOVAMs to assure that 
data exist on which to base estimates of curvi- 
linearity. The imperfect implementation of 
two-level deiigns is sufficient to assure this 
capability in Phase"! 1 1, so that no explicit 
effort need be made to implement four or 
more levels in a design. Even three levels 
r.my be unnecessary to ensure estimability of 
curvilinearity. However, three-level designs 
improve flexibility in fitting designs totalling 
about 32 centers, and they vyill be considered, 
along with two-level designs, in Phase ML 
Table 6-3 exhibks the flexibility permitted 
under these constraints. . % 



Table 6 3 
^ Alternative Factorial Designs 



Number of Nurnbarof 

Alternative EKperlmental Centers 

Factorial Design Factors Per RepllGate 

.2x2 2 ^ 4 

2x3 2 6 

3x3 2 9 

2x2x2 3 8 

3x2x2 3 12 

2x2x2x2 4' 16 

3x3x2 3 18 

2x2x2x2x2 5 32 

3x 3 x 2 x 2 4 36 
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Table 6 4 








/ 




Potential Site/FaGtorial Deiigns 










(One or More Full Replicates Overall) 






Site Number 


Numbi 


r of Centei^ 


Number of 


Total 




of 


Factor la li 




Replicates 


Study 




Design Sites 


Design Per Replicate 


Per Site 


Centari 




i i 
1 1 


2x2 


. 4 


a 


'in 


\ 




2x3 


4 ^ 


6 


Jq 


\ 




3x3 


9 


- 4 


3d 


\ 




2x2x2 


8 


4 








3x2x2 


12 


3 


36 






. '2,x2x2x2 


16 


2 


32 






3x3x2 




2 - 


Jo 






3x3x2x2 


36 J 


1 


do 






2^ x 2 X 2 X 2 X 2 


22. 


1 






1 1 2 


2x2 


4 


4/4 


od 






2x3 


6 




Jo * 






3x3 


9 


2/2 


36 






2x2x2 


8 


2/2 


32 






2x2x2x2 


16 


1/1 


32 






3x3x2 


18 /\ 


1/1 


- 36 






2x2x2x2x2 


32 ^ 


1/1 . 


64 






2x2x2x2 X 2 


*32 


%m 


32 




III ■ ' 
III 3 


2x3 


6 


2/2/2 


3b 




3 


^ w O 
J X ^ X ^ 


1 Q 


1/1/1 


36 




IV 3 


2x2 


4 


4/2/2 


od 






3x3 


g 


2/1/1 


Jo 






2x2x2 " 


8 


2/1/1 


32 






2x2x2* 


8 


4/2/2 


D4 






2x2x2x2 


16 


l/H/H 


32 




J' 


2x2x2x2x2 


32 


H/y4/y4 


32 






2x2x2x2x2 


32 


1/H/H 


64 




* Current Design 













Combining the options of Table 6-2 with 
those of Table 6-3 leads to the design options 
oxhibited in Table 6-4. Two 64 center de- 
signs hove been inrcluded to provide additional 
alternativQS* Site and center selection plans 
will not be greatly limited by constraining 
the options to those displayed, Designs involv* 



ing fractional replication invo\ve too man9 
factors and constraints to hope for even ap- 
proximate implementation, 

The basic building block of each design is the' 
definition of the replicate or block which Is 
a factorial design in two or more variables, 
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For instcinqo, tho 2x2 design would includo 
staff/child ratio and professionalism, each at 
two luvols and fully crossed. The 3 k 2 x 2 
design would treat staff/child ratio at three 
tovcls to obtain a more uniform spread, while 
retaining professionalium and group size at 
two levels. For a replicate of given size, there 
is a tradeoff between the levels of representa^ 
tion of policy variables and other independent 
variables, and in the choice of variables. 



Tho second part of the design is the assign= 
ment of replicates to sites, If a potential situ 
effect is not to be confounded with any other 
effect or interaction, then whole numbers of 
replicates would be assigned to each site. 
The Phase II design is an example in which a 
basic 2x2x2 factorial design is replicated 
four times in Atlanta and twice each in 
Seattle and Detroit, so that 64 centers are 
divided 32/16/16 arnong the sites. 
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